Sep 16 21:49:11.270367 ip-10-0-142-168 systemd[1]: Starting Kubernetes Kubelet... Sep 16 21:49:11.648821 ip-10-0-142-168 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 21:49:11.648821 ip-10-0-142-168 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 21:49:11.648821 ip-10-0-142-168 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 21:49:11.648821 ip-10-0-142-168 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 21:49:11.648821 ip-10-0-142-168 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 21:49:11.650354 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.650259 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 21:49:11.654105 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654086 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 21:49:11.654105 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654102 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 21:49:11.654105 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654107 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 21:49:11.654105 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654111 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654115 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654120 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654123 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654127 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654131 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654135 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654140 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654146 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654151 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654155 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654159 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654163 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654167 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654171 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654175 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654178 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654188 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654192 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654196 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 21:49:11.654356 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654200 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654204 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654207 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654211 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654215 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654219 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654223 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654230 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654236 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654240 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654244 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654249 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654253 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654257 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654262 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654268 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654272 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654276 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654281 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654285 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 21:49:11.655121 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654289 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654293 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654297 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654303 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654307 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654311 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654315 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654320 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654325 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654330 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654333 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654338 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654342 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654347 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654351 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654355 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654359 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654363 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654367 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654372 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 21:49:11.655664 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654376 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654380 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654384 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654388 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654392 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654396 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654402 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654409 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654414 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654420 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654425 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654429 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654433 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654437 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654442 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654446 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654450 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654454 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654458 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654462 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 21:49:11.656179 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654466 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654471 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654475 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654480 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654484 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654488 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654492 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654496 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654500 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654504 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654511 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654516 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654520 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654524 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654528 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 21:49:11.656836 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.654532 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657244 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657256 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657261 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657266 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657271 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657281 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657285 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657289 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657293 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657297 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657301 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657305 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657309 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657313 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657317 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657322 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657326 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657330 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657334 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 21:49:11.657498 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657337 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657341 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657345 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657350 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657354 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657358 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657361 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657365 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657369 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657373 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657377 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657381 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657385 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657389 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657394 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657399 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657403 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657407 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657411 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657416 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 21:49:11.658387 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657420 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657424 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657428 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657432 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657436 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657443 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657448 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657453 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657458 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657462 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657466 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657471 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657475 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657479 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657483 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657488 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657491 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657495 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657499 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 21:49:11.659278 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657503 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657507 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657511 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657515 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657519 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657523 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657527 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657534 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657538 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657542 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657548 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657552 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657557 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657561 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657565 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657572 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657580 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657585 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657589 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 21:49:11.660162 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657594 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657598 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657602 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657606 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657610 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657617 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657622 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657627 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657631 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657635 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657639 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657643 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657649 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657653 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657657 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657661 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657665 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657669 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657673 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657678 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 21:49:11.660751 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657682 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.657686 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658354 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658364 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658368 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658373 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658383 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658388 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658392 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658396 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658401 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658404 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658408 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658412 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658417 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658421 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658425 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658429 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658434 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658437 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 21:49:11.661320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658442 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658447 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658453 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658459 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658466 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658471 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658476 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658481 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658485 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658490 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658494 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658498 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658502 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658506 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658509 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658514 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658518 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658522 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658526 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658532 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 21:49:11.661871 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658538 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658544 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658549 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658553 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658558 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658562 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658566 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658570 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658574 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658578 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658582 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658586 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658590 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658595 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658599 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658603 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658608 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658612 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658616 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658620 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 21:49:11.662396 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658624 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658628 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658632 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658637 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658641 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658645 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658649 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658653 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658657 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658661 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658665 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658670 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658674 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658678 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658682 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658687 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658691 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658695 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658698 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 21:49:11.663131 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658702 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658706 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658710 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658714 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658718 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658723 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658727 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658733 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658737 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658741 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658746 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658750 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658754 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658758 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658762 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658766 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658770 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658774 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658779 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 21:49:11.663603 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658783 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658789 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.658794 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658889 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658943 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658952 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658959 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658967 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658972 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658978 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658985 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658990 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.658994 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659000 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659005 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659010 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659015 2575 flags.go:64] FLAG: --cgroup-root="" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659019 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659025 2575 flags.go:64] FLAG: --client-ca-file="" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659029 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659034 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659040 2575 flags.go:64] FLAG: --cluster-domain="" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659046 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 21:49:11.664173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659052 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659057 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659082 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659089 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659093 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659098 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659104 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659108 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659113 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659117 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659122 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659127 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659133 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659138 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659143 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659147 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659152 2575 flags.go:64] FLAG: --enable-server="true" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659158 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659165 2575 flags.go:64] FLAG: --event-burst="100" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659170 2575 flags.go:64] FLAG: --event-qps="50" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659174 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659179 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659184 2575 flags.go:64] FLAG: --eviction-hard="" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659190 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 21:49:11.664777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659194 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659199 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659204 2575 flags.go:64] FLAG: --eviction-soft="" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659210 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659214 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659219 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659223 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659230 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659235 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659240 2575 flags.go:64] FLAG: --feature-gates="" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659246 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659250 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659255 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659260 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659265 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659270 2575 flags.go:64] FLAG: --help="false" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659274 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-168.ec2.internal" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659279 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659283 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659288 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659293 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659299 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659303 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 21:49:11.665448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659307 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659312 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659317 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659323 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659328 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659333 2575 flags.go:64] FLAG: --kube-reserved="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659338 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659342 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659347 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659351 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659355 2575 flags.go:64] FLAG: --lock-file="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659360 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659365 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659370 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659378 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659382 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659388 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659393 2575 flags.go:64] FLAG: --logging-format="text" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659398 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659403 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659415 2575 flags.go:64] FLAG: --manifest-url="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659420 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659431 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659436 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659442 2575 flags.go:64] FLAG: --max-pods="110" Sep 16 21:49:11.666176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659447 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659451 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659456 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659461 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659466 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659471 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659476 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659486 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659491 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659495 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659500 2575 flags.go:64] FLAG: --pod-cidr="" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659505 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659514 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659518 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659524 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659528 2575 flags.go:64] FLAG: --port="10250" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659533 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659537 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b4edf1c347168f45" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659543 2575 flags.go:64] FLAG: --qos-reserved="" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659548 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659553 2575 flags.go:64] FLAG: --register-node="true" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659557 2575 flags.go:64] FLAG: --register-with-taints="" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659563 2575 flags.go:64] FLAG: --registry-burst="10" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659570 2575 flags.go:64] FLAG: --registry-qps="5" Sep 16 21:49:11.667376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659574 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659579 2575 flags.go:64] FLAG: --reserved-memory="" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659585 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659590 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659595 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659600 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659604 2575 flags.go:64] FLAG: --runonce="false" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659609 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659613 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659619 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659623 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659628 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659633 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659638 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659642 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659647 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659651 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659655 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659660 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659665 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659670 2575 flags.go:64] FLAG: --system-cgroups="" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659675 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659684 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659688 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659693 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 21:49:11.668410 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659699 2575 flags.go:64] FLAG: --tls-min-version="" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659704 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659708 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659713 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659718 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659723 2575 flags.go:64] FLAG: --v="2" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659730 2575 flags.go:64] FLAG: --version="false" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659736 2575 flags.go:64] FLAG: --vmodule="" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659742 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.659747 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659924 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659932 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659937 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659942 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659946 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659951 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659955 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659959 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659963 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659967 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659974 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659980 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 21:49:11.669232 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659985 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659989 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659994 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.659999 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660004 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660008 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660013 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660017 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660021 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660028 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660032 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660036 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660039 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660044 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660050 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660055 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660092 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660098 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660102 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 21:49:11.669765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660106 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660112 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660118 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660123 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660127 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660132 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660137 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660141 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660145 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660150 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660154 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660158 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660163 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660168 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660172 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660176 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660180 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660185 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660189 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 21:49:11.670284 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660193 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660207 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660212 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660220 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660224 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660228 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660232 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660236 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660240 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660244 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660248 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660252 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660257 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660261 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660265 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660269 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660273 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660277 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660281 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660285 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 21:49:11.670742 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660289 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660293 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660297 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660301 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660305 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660317 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660321 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660325 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660329 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660333 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660337 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660341 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660345 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660349 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660361 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660366 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660370 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660375 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660379 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660383 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 21:49:11.671313 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660387 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660391 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660395 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660399 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660404 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660408 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660412 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660416 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.660420 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.661207 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.669253 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.669271 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.669987 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.669994 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 21:49:11.671805 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670087 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670094 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670097 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670100 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670103 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670105 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670109 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670114 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670117 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670120 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670123 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670126 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670128 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670131 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670133 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670136 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670139 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670141 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670144 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 21:49:11.672176 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670146 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670149 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670151 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670154 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670156 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670159 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670161 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670164 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670167 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670169 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670178 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670181 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670183 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670186 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670188 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670191 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670194 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670196 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670199 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670201 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 21:49:11.672642 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670203 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670206 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670208 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670211 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670213 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670216 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670218 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670221 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670223 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670226 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670228 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670231 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670233 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670236 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670238 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670240 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670243 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670245 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670249 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 21:49:11.673160 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670253 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670256 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670259 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670261 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670269 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670272 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670274 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670276 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670279 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670281 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670284 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670286 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670289 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670292 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670294 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670297 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670305 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670308 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670310 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670312 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 21:49:11.673665 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670315 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670317 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670320 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670322 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670325 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670327 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670330 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670333 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670335 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670337 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670340 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670342 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670345 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670347 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670351 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670355 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670359 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670366 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670369 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 21:49:11.674172 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670372 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670375 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.670380 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670541 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670545 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670548 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670551 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670554 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670557 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670560 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670562 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670565 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670567 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670570 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670572 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 21:49:11.674626 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670575 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670577 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670580 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670582 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670584 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670586 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670590 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670593 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670596 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670598 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670601 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670603 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670606 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670608 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670611 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670613 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670621 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670624 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670626 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 21:49:11.675004 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670629 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670631 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670633 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670636 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670638 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670641 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670643 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670645 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670648 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670650 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670653 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670655 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670657 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670660 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670662 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670665 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670667 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670670 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670672 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670675 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 21:49:11.675490 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670677 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670680 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670684 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670687 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670690 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670692 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670695 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670698 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670701 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670704 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670712 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670715 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670717 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670720 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670722 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670725 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670727 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670730 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670732 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 21:49:11.675977 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670734 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670737 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670739 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670742 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670744 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670747 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670750 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670753 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670755 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670758 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670760 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670763 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670765 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670768 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670770 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670772 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670775 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670777 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670780 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670782 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 21:49:11.676437 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670785 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670787 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670789 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670792 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670802 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670805 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670808 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670810 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:11.670813 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.670818 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.670925 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.673030 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.673922 2575 server.go:1019] "Starting client certificate rotation" Sep 16 21:49:11.676903 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.674027 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 21:49:11.677242 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.674074 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 21:49:11.677242 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.676484 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 21:49:11.681124 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.681035 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 21:49:11.690664 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.690648 2575 log.go:25] "Validated CRI v1 runtime API" Sep 16 21:49:11.693464 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.693450 2575 log.go:25] "Validated CRI v1 image API" Sep 16 21:49:11.694353 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.694339 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 21:49:11.697506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.697481 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9f831e88-93ae-4dfd-8f3a-8129ca4d8f4e:/dev/nvme0n1p4 bc1eec27-c8d9-4981-bd4f-9dc2b5b7b423:/dev/nvme0n1p3] Sep 16 21:49:11.697506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.697500 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 21:49:11.701730 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.701712 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 21:49:11.702450 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.702338 2575 manager.go:216] Machine: {Timestamp:2026-09-16 21:49:11.701138103 +0000 UTC m=+0.318500954 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101045 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4ada042b3cf5010d12686994d806 SystemUUID:ec2b4ada-042b-3cf5-010d-12686994d806 BootID:bc7b7578-eb6f-483e-9d45-a4d6dbb7a48a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e7:9b:f2:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e7:9b:f2:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:ea:9b:2d:2f:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 21:49:11.702450 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.702446 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 21:49:11.702567 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.702556 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 21:49:11.705264 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.705235 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 21:49:11.705406 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.705266 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 21:49:11.706100 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.706091 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 21:49:11.706136 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.706103 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 21:49:11.706136 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.706111 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 21:49:11.706665 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.706655 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 21:49:11.707405 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.707396 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 21:49:11.710160 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710149 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 16 21:49:11.710272 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710263 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 21:49:11.710301 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710294 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 16 21:49:11.710334 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710309 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 21:49:11.710367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710332 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 21:49:11.710367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710347 2575 kubelet.go:398] "Adding apiserver pod source" Sep 16 21:49:11.710367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710358 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 21:49:11.710772 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710760 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 21:49:11.710813 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.710780 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 21:49:11.712659 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.712632 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 21:49:11.715025 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.715008 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 21:49:11.715134 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.715046 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 21:49:11.717387 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717370 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717396 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717405 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717413 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717425 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717433 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717452 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 21:49:11.717477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717464 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 21:49:11.717724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717493 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 21:49:11.717724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717502 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 21:49:11.717724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717515 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 21:49:11.717724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.717523 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 21:49:11.719085 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.719056 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 21:49:11.719164 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.719089 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 21:49:11.720296 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.720254 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 21:49:11.720379 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.720296 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 21:49:11.722929 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.722914 2575 server.go:1268] "Started kubelet" Sep 16 21:49:11.723040 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.722997 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 21:49:11.723145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.723059 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 21:49:11.723145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.722997 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 21:49:11.723838 ip-10-0-142-168 systemd[1]: Started Kubernetes Kubelet. Sep 16 21:49:11.726733 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.726707 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 21:49:11.727907 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.727886 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5c8m" Sep 16 21:49:11.729223 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.729205 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 16 21:49:11.729924 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.729855 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 21:49:11.730804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.730787 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5c8m" Sep 16 21:49:11.735982 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.735964 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 21:49:11.736836 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.736005 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-168.ec2.internal.18d5eb7d9f2206a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-168.ec2.internal,UID:ip-10-0-142-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-168.ec2.internal,},FirstTimestamp:2026-09-16 21:49:11.722886822 +0000 UTC m=+0.340249672,LastTimestamp:2026-09-16 21:49:11.722886822 +0000 UTC m=+0.340249672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-168.ec2.internal,}" Sep 16 21:49:11.745629 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.745604 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 21:49:11.745913 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.745899 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 21:49:11.746264 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.746247 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:11.746766 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746721 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 21:49:11.746766 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746738 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 21:49:11.747055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746884 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 16 21:49:11.747055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746892 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 16 21:49:11.747055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746901 2575 factory.go:55] Registering systemd factory Sep 16 21:49:11.747055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746915 2575 factory.go:223] Registration of the systemd container factory successfully Sep 16 21:49:11.747055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.746986 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 21:49:11.747377 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.747363 2575 factory.go:153] Registering CRI-O factory Sep 16 21:49:11.747471 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.747380 2575 factory.go:223] Registration of the crio container factory successfully Sep 16 21:49:11.747508 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.747476 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 21:49:11.747508 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.747494 2575 factory.go:103] Registering Raw factory Sep 16 21:49:11.747508 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.747506 2575 manager.go:1196] Started watching for new ooms in manager Sep 16 21:49:11.747924 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.747911 2575 manager.go:349] Starting recovery of all containers Sep 16 21:49:11.748789 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.748757 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 16 21:49:11.754594 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.754551 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 21:49:11.759791 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.759775 2575 manager.go:354] Recovery completed Sep 16 21:49:11.760324 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.760304 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 21:49:11.763925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.763907 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.765762 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.765745 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.765816 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.765783 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.765868 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.765816 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:11.766476 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.766451 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 21:49:11.766476 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.766464 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 21:49:11.766593 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.766484 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 16 21:49:11.766593 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.766467 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.767424 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.767400 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.767486 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.767435 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.767486 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.767445 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:11.767770 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.767757 2575 policy_none.go:49] "None policy: Start" Sep 16 21:49:11.767799 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.767777 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 21:49:11.767799 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.767791 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 21:49:11.768850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.768837 2575 policy_none.go:47] "Start" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.811669 2575 manager.go:337] "Starting Device Plugin manager" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.811820 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.811830 2575 server.go:87] "Starting device plugin registration server" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.812191 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.812205 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.812314 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.812392 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.812400 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.812918 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 21:49:11.813239 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.812963 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:11.879197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.879173 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 21:49:11.879313 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.879225 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 21:49:11.879313 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.879247 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 21:49:11.879397 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.879322 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 16 21:49:11.881031 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.881014 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 21:49:11.913231 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.913159 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.914021 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.914004 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.914150 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.914037 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.914150 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.914052 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:11.914150 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.914102 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-168.ec2.internal" Sep 16 21:49:11.921390 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.921373 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-168.ec2.internal" Sep 16 21:49:11.921457 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.921396 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-168.ec2.internal\": node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:11.933791 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:11.933770 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:11.979611 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.979588 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal"] Sep 16 21:49:11.979709 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.979662 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.981134 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.981117 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.981230 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.981152 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.981230 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.981170 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:11.982439 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.982425 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.982568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.982543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:11.982618 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.982572 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.983156 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.983140 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.983224 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.983171 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.983224 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.983183 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:11.983693 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.983676 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.983745 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.983710 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.983745 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.983725 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:11.984888 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.984872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" Sep 16 21:49:11.984942 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.984899 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 21:49:11.985532 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.985517 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientMemory" Sep 16 21:49:11.985599 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.985544 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 21:49:11.985599 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:11.985558 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeHasSufficientPID" Sep 16 21:49:12.016755 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.016730 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-168.ec2.internal\" not found" node="ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.021025 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.021012 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-168.ec2.internal\" not found" node="ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.034280 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.034267 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.049174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.049158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9739dcdafac449dab20c394bd816ec36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal\" (UID: \"9739dcdafac449dab20c394bd816ec36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.049254 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.049190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9739dcdafac449dab20c394bd816ec36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal\" (UID: \"9739dcdafac449dab20c394bd816ec36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.049254 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.049208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/120b065a204276bba7b5eb34956aed54-config\") pod \"kube-apiserver-proxy-ip-10-0-142-168.ec2.internal\" (UID: \"120b065a204276bba7b5eb34956aed54\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.135001 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.134963 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.150305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.150287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/120b065a204276bba7b5eb34956aed54-config\") pod \"kube-apiserver-proxy-ip-10-0-142-168.ec2.internal\" (UID: \"120b065a204276bba7b5eb34956aed54\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.150386 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.150312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9739dcdafac449dab20c394bd816ec36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal\" (UID: \"9739dcdafac449dab20c394bd816ec36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.150386 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.150330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9739dcdafac449dab20c394bd816ec36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal\" (UID: \"9739dcdafac449dab20c394bd816ec36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.150523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.150390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9739dcdafac449dab20c394bd816ec36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal\" (UID: \"9739dcdafac449dab20c394bd816ec36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.150523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.150395 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/120b065a204276bba7b5eb34956aed54-config\") pod \"kube-apiserver-proxy-ip-10-0-142-168.ec2.internal\" (UID: \"120b065a204276bba7b5eb34956aed54\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.150523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.150415 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9739dcdafac449dab20c394bd816ec36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal\" (UID: \"9739dcdafac449dab20c394bd816ec36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.235753 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.235682 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.319198 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.319154 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.324151 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.324133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.336790 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.336770 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.437336 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.437302 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.537869 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.537790 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.638391 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.638357 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.673864 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.673829 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 21:49:12.674397 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.673975 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 21:49:12.674397 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.674011 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 21:49:12.739028 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.739000 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.747245 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.747201 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 21:44:11 +0000 UTC" deadline="2028-06-02 15:45:03.0180975 +0000 UTC" Sep 16 21:49:12.747245 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.747242 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14993h55m50.27085917s" Sep 16 21:49:12.823647 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:12.823615 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9739dcdafac449dab20c394bd816ec36.slice/crio-cbc90aac77c604c65af4c629b2805caedfde01adbecd77f8315ccd4323aead30 WatchSource:0}: Error finding container cbc90aac77c604c65af4c629b2805caedfde01adbecd77f8315ccd4323aead30: Status 404 returned error can't find the container with id cbc90aac77c604c65af4c629b2805caedfde01adbecd77f8315ccd4323aead30 Sep 16 21:49:12.823862 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:12.823841 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120b065a204276bba7b5eb34956aed54.slice/crio-fe9f2f08af7da32c05ceb34f07b707ee89150946b419d1ed5383476ca380707e WatchSource:0}: Error finding container fe9f2f08af7da32c05ceb34f07b707ee89150946b419d1ed5383476ca380707e: Status 404 returned error can't find the container with id fe9f2f08af7da32c05ceb34f07b707ee89150946b419d1ed5383476ca380707e Sep 16 21:49:12.828820 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.828795 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 21:49:12.839776 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:12.839756 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-168.ec2.internal\" not found" Sep 16 21:49:12.843634 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.843618 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 21:49:12.847495 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.847477 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.858745 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.858723 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 21:49:12.861084 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.861056 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" Sep 16 21:49:12.868724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.868702 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 21:49:12.883250 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.883205 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" event={"ID":"9739dcdafac449dab20c394bd816ec36","Type":"ContainerStarted","Data":"cbc90aac77c604c65af4c629b2805caedfde01adbecd77f8315ccd4323aead30"} Sep 16 21:49:12.884342 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:12.884317 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" event={"ID":"120b065a204276bba7b5eb34956aed54","Type":"ContainerStarted","Data":"fe9f2f08af7da32c05ceb34f07b707ee89150946b419d1ed5383476ca380707e"} Sep 16 21:49:13.024161 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.024137 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 21:49:13.711414 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.711365 2575 apiserver.go:52] "Watching apiserver" Sep 16 21:49:13.723214 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.723076 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 21:49:13.725162 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.725123 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-wvmvr","openshift-ovn-kubernetes/ovnkube-node-tplfl","kube-system/konnectivity-agent-9zll6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54","openshift-image-registry/node-ca-ngkgc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal","openshift-network-diagnostics/network-check-target-bxjg2","openshift-network-operator/iptables-alerter-w5lqw","kube-system/global-pull-secret-syncer-6wls8","kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jnszv","openshift-dns/node-resolver-hd65k","openshift-multus/multus-additional-cni-plugins-bcfrs","openshift-multus/multus-rmj2b"] Sep 16 21:49:13.726793 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.726768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:13.726917 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.726889 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:13.727990 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.727966 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.729136 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.729108 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.730552 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.730531 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 21:49:13.730845 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.730820 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 21:49:13.730970 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.730957 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.731039 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.730847 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8w97j\"" Sep 16 21:49:13.731111 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.731088 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 21:49:13.731207 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.731186 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.731498 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.731474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.732189 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.731882 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 21:49:13.732189 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.731967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 21:49:13.732189 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.732098 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xsccz\"" Sep 16 21:49:13.732731 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.732604 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 21:49:13.732731 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.732668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.734037 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.734019 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 21:49:13.734723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.734299 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.734723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.734343 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-85kdw\"" Sep 16 21:49:13.734723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.734582 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.734923 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.734904 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.735498 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.735478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.735786 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.735768 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 21:49:13.735904 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.735841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.736004 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.735990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-55zl7\"" Sep 16 21:49:13.738322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.738301 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 21:49:13.738322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.738307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kbhhr\"" Sep 16 21:49:13.738716 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.738693 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.738812 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.738763 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:13.740392 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.740373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:13.740524 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.740448 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:13.742049 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.742031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.743739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.743718 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.745231 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.745211 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 21:49:13.745394 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.745378 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.745567 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.745530 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 21:49:13.745955 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.745936 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 21:49:13.746027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.746007 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.746123 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.746075 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 21:49:13.746212 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.746008 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.746954 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.746934 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.747451 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.747428 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 21:49:13.747590 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.747566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.747841 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.747826 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 21:49:13.747923 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.747910 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g4rzs\"" Sep 16 21:49:13.747977 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.747435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kgd62\"" Sep 16 21:49:13.748459 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.748441 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.748702 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.748681 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 21:49:13.749004 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.748982 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.749530 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.749477 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ld75\"" Sep 16 21:49:13.749750 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.749734 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.750021 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.750003 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 21:49:13.750380 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.750363 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 21:49:13.752138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.752107 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dnm92\"" Sep 16 21:49:13.759422 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42913e30-c690-4951-94f5-6ec37cee6572-ovn-node-metrics-cert\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.759522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-cni-binary-copy\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.759522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysctl-d\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.759522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759483 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 21:49:13.759522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-systemd\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db0d1bde-1bc1-4d19-9cf0-598e1c127756-konnectivity-ca\") pod \"konnectivity-agent-9zll6\" (UID: \"db0d1bde-1bc1-4d19-9cf0-598e1c127756\") " pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-socket-dir-parent\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-var-lib-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c198f991-41aa-4b51-88d4-eafb5aef8848-iptables-alerter-script\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q89c\" (UniqueName: \"kubernetes.io/projected/a1ddf3a2-e69f-4a4a-be18-189741792a27-kube-api-access-7q89c\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.759739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-lib-modules\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpc5g\" (UniqueName: \"kubernetes.io/projected/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-kube-api-access-lpc5g\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ba37ea-2c67-4471-8c7e-47cbda4e4753-host\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80ba37ea-2c67-4471-8c7e-47cbda4e4753-serviceca\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-netns\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-slash\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-etc-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.759969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-ovn\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-cni-bin\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-cni-netd\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-run-ovn-kubernetes\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-env-overrides\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-registration-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-tuned\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j42cf\" (UniqueName: \"kubernetes.io/projected/8e0af835-f817-433f-adbe-6b1c5afd2279-kube-api-access-j42cf\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-tmp-dir\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-ovnkube-script-lib\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-sys-fs\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-modprobe-d\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-var-lib-kubelet\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e0af835-f817-433f-adbe-6b1c5afd2279-tmp\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-run-netns\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpd6l\" (UniqueName: \"kubernetes.io/projected/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-kube-api-access-fpd6l\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-cnibin\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-hostroot\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-ovnkube-config\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.760723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysconfig\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-run\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/554c602e-8d33-486b-88f8-cd67717ffc0b-cni-binary-copy\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-daemon-config\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-multus-certs\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxfg\" (UniqueName: \"kubernetes.io/projected/03c0257e-db92-46d2-a4e7-24b601504022-kube-api-access-zjxfg\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq54r\" (UniqueName: \"kubernetes.io/projected/c198f991-41aa-4b51-88d4-eafb5aef8848-kube-api-access-sq54r\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-kubernetes\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-cni-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-k8s-cni-cncf-io\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.760982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/593ba305-2eaf-4f74-830d-00b910be26a2-dbus\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2p2\" (UniqueName: \"kubernetes.io/projected/42913e30-c690-4951-94f5-6ec37cee6572-kube-api-access-nd2p2\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761356 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysctl-conf\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-etc-kubernetes\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.761504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-conf-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-system-cni-dir\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfc9n\" (UniqueName: \"kubernetes.io/projected/80ba37ea-2c67-4471-8c7e-47cbda4e4753-kube-api-access-sfc9n\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-systemd-units\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-host\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-hosts-file\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-cni-bin\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfqt\" (UniqueName: \"kubernetes.io/projected/554c602e-8d33-486b-88f8-cd67717ffc0b-kube-api-access-wcfqt\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-kubelet\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-log-socket\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-cnibin\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db0d1bde-1bc1-4d19-9cf0-598e1c127756-agent-certs\") pod \"konnectivity-agent-9zll6\" (UID: \"db0d1bde-1bc1-4d19-9cf0-598e1c127756\") " pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-systemd\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-etc-selinux\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.762367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/593ba305-2eaf-4f74-830d-00b910be26a2-kubelet-config\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-system-cni-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.761989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-cni-multus\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-node-log\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-device-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-sys\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-kubelet\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c198f991-41aa-4b51-88d4-eafb5aef8848-host-slash\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.763317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.762200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-socket-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.776003 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.775977 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8jxk" Sep 16 21:49:13.785019 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.784989 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8jxk" Sep 16 21:49:13.862481 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862446 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-socket-dir-parent\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-var-lib-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c198f991-41aa-4b51-88d4-eafb5aef8848-iptables-alerter-script\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q89c\" (UniqueName: \"kubernetes.io/projected/a1ddf3a2-e69f-4a4a-be18-189741792a27-kube-api-access-7q89c\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-lib-modules\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-var-lib-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-socket-dir-parent\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.862660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpc5g\" (UniqueName: \"kubernetes.io/projected/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-kube-api-access-lpc5g\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ba37ea-2c67-4471-8c7e-47cbda4e4753-host\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80ba37ea-2c67-4471-8c7e-47cbda4e4753-serviceca\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-netns\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-slash\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-etc-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-ovn\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-cni-bin\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-cni-netd\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-run-ovn-kubernetes\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-env-overrides\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863041 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863104 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-registration-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-tuned\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j42cf\" (UniqueName: \"kubernetes.io/projected/8e0af835-f817-433f-adbe-6b1c5afd2279-kube-api-access-j42cf\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863215 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ba37ea-2c67-4471-8c7e-47cbda4e4753-host\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.862791 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-lib-modules\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c198f991-41aa-4b51-88d4-eafb5aef8848-iptables-alerter-script\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-tmp-dir\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863312 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80ba37ea-2c67-4471-8c7e-47cbda4e4753-serviceca\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-ovnkube-script-lib\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-slash\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-sys-fs\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-etc-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-ovn\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-cni-bin\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-run-ovn-kubernetes\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-netns\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.863606 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-sys-fs\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-cni-netd\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-registration-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863834 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-tmp-dir\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863892 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-env-overrides\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-modprobe-d\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.863991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-var-lib-kubelet\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e0af835-f817-433f-adbe-6b1c5afd2279-tmp\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864079 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-run-netns\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpd6l\" (UniqueName: \"kubernetes.io/projected/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-kube-api-access-fpd6l\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864191 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864205 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-ovnkube-script-lib\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864310 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-var-lib-kubelet\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-cnibin\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.864539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-cnibin\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-run-netns\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-modprobe-d\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-hostroot\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864712 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-hostroot\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-ovnkube-config\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysconfig\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-run\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/554c602e-8d33-486b-88f8-cd67717ffc0b-cni-binary-copy\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-daemon-config\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864866 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-run\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysconfig\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-multus-certs\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.864956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-multus-certs\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.865344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865310 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42913e30-c690-4951-94f5-6ec37cee6572-ovnkube-config\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxfg\" (UniqueName: \"kubernetes.io/projected/03c0257e-db92-46d2-a4e7-24b601504022-kube-api-access-zjxfg\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-daemon-config\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq54r\" (UniqueName: \"kubernetes.io/projected/c198f991-41aa-4b51-88d4-eafb5aef8848-kube-api-access-sq54r\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-kubernetes\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-cni-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-k8s-cni-cncf-io\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/593ba305-2eaf-4f74-830d-00b910be26a2-dbus\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2p2\" (UniqueName: \"kubernetes.io/projected/42913e30-c690-4951-94f5-6ec37cee6572-kube-api-access-nd2p2\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysctl-conf\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-etc-kubernetes\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-conf-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.865842 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysctl-conf\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865753 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-cni-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.866166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.865961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-system-cni-dir\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.865984 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.365956208 +0000 UTC m=+2.983319051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-system-cni-dir\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfc9n\" (UniqueName: \"kubernetes.io/projected/80ba37ea-2c67-4471-8c7e-47cbda4e4753-kube-api-access-sfc9n\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866041 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/554c602e-8d33-486b-88f8-cd67717ffc0b-cni-binary-copy\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-systemd-units\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/593ba305-2eaf-4f74-830d-00b910be26a2-dbus\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866091 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-systemd-units\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-host\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866061 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-kubernetes\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866122 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-etc-kubernetes\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-hosts-file\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-multus-conf-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-host\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-cni-bin\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfqt\" (UniqueName: \"kubernetes.io/projected/554c602e-8d33-486b-88f8-cd67717ffc0b-kube-api-access-wcfqt\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866248 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-run-k8s-cni-cncf-io\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.867027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-hosts-file\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-cni-bin\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-kubelet\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.866345 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-host-kubelet\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-log-socket\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.866411 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.366392997 +0000 UTC m=+2.983755852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866426 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-log-socket\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-cnibin\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db0d1bde-1bc1-4d19-9cf0-598e1c127756-agent-certs\") pod \"konnectivity-agent-9zll6\" (UID: \"db0d1bde-1bc1-4d19-9cf0-598e1c127756\") " pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-cnibin\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-systemd\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-etc-selinux\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/593ba305-2eaf-4f74-830d-00b910be26a2-kubelet-config\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-system-cni-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.868114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-etc-selinux\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-systemd\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/593ba305-2eaf-4f74-830d-00b910be26a2-kubelet-config\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-cni-multus\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-cni-multus\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-system-cni-dir\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-node-log\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-node-log\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-device-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-sys\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-device-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-kubelet\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.866974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-sys\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/554c602e-8d33-486b-88f8-cd67717ffc0b-host-var-lib-kubelet\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42913e30-c690-4951-94f5-6ec37cee6572-run-openvswitch\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c198f991-41aa-4b51-88d4-eafb5aef8848-host-slash\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-socket-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.869063 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42913e30-c690-4951-94f5-6ec37cee6572-ovn-node-metrics-cert\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867275 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-cni-binary-copy\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c198f991-41aa-4b51-88d4-eafb5aef8848-host-slash\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysctl-d\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-systemd\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1ddf3a2-e69f-4a4a-be18-189741792a27-socket-dir\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db0d1bde-1bc1-4d19-9cf0-598e1c127756-konnectivity-ca\") pod \"konnectivity-agent-9zll6\" (UID: \"db0d1bde-1bc1-4d19-9cf0-598e1c127756\") " pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867405 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-systemd\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867408 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-sysctl-d\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03c0257e-db92-46d2-a4e7-24b601504022-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867895 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03c0257e-db92-46d2-a4e7-24b601504022-cni-binary-copy\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.867986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db0d1bde-1bc1-4d19-9cf0-598e1c127756-konnectivity-ca\") pod \"konnectivity-agent-9zll6\" (UID: \"db0d1bde-1bc1-4d19-9cf0-598e1c127756\") " pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.868426 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e0af835-f817-433f-adbe-6b1c5afd2279-etc-tuned\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.869056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e0af835-f817-433f-adbe-6b1c5afd2279-tmp\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.869946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.869647 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db0d1bde-1bc1-4d19-9cf0-598e1c127756-agent-certs\") pod \"konnectivity-agent-9zll6\" (UID: \"db0d1bde-1bc1-4d19-9cf0-598e1c127756\") " pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:13.870928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.870294 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42913e30-c690-4951-94f5-6ec37cee6572-ovn-node-metrics-cert\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.871505 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.871474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpc5g\" (UniqueName: \"kubernetes.io/projected/7d17bf83-68f1-4996-acf8-cf9cc688ac9b-kube-api-access-lpc5g\") pod \"node-resolver-hd65k\" (UID: \"7d17bf83-68f1-4996-acf8-cf9cc688ac9b\") " pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:13.871626 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.871571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q89c\" (UniqueName: \"kubernetes.io/projected/a1ddf3a2-e69f-4a4a-be18-189741792a27-kube-api-access-7q89c\") pod \"aws-ebs-csi-driver-node-dql54\" (UID: \"a1ddf3a2-e69f-4a4a-be18-189741792a27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:13.872543 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.872339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j42cf\" (UniqueName: \"kubernetes.io/projected/8e0af835-f817-433f-adbe-6b1c5afd2279-kube-api-access-j42cf\") pod \"tuned-jnszv\" (UID: \"8e0af835-f817-433f-adbe-6b1c5afd2279\") " pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:13.872644 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.872563 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:13.872644 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.872594 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:13.872644 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.872612 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:13.874218 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:13.873450 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.373423295 +0000 UTC m=+2.990786158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:13.875269 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.874822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpd6l\" (UniqueName: \"kubernetes.io/projected/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-kube-api-access-fpd6l\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:13.878197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.876009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxfg\" (UniqueName: \"kubernetes.io/projected/03c0257e-db92-46d2-a4e7-24b601504022-kube-api-access-zjxfg\") pod \"multus-additional-cni-plugins-bcfrs\" (UID: \"03c0257e-db92-46d2-a4e7-24b601504022\") " pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:13.878197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.876383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfqt\" (UniqueName: \"kubernetes.io/projected/554c602e-8d33-486b-88f8-cd67717ffc0b-kube-api-access-wcfqt\") pod \"multus-rmj2b\" (UID: \"554c602e-8d33-486b-88f8-cd67717ffc0b\") " pod="openshift-multus/multus-rmj2b" Sep 16 21:49:13.878197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.876663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2p2\" (UniqueName: \"kubernetes.io/projected/42913e30-c690-4951-94f5-6ec37cee6572-kube-api-access-nd2p2\") pod \"ovnkube-node-tplfl\" (UID: \"42913e30-c690-4951-94f5-6ec37cee6572\") " pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:13.878197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.876979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq54r\" (UniqueName: \"kubernetes.io/projected/c198f991-41aa-4b51-88d4-eafb5aef8848-kube-api-access-sq54r\") pod \"iptables-alerter-w5lqw\" (UID: \"c198f991-41aa-4b51-88d4-eafb5aef8848\") " pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:13.878197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.877504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfc9n\" (UniqueName: \"kubernetes.io/projected/80ba37ea-2c67-4471-8c7e-47cbda4e4753-kube-api-access-sfc9n\") pod \"node-ca-ngkgc\" (UID: \"80ba37ea-2c67-4471-8c7e-47cbda4e4753\") " pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:13.885358 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:13.885333 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 21:49:14.042402 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.042314 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" Sep 16 21:49:14.050867 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.050842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:14.061032 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.061005 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" Sep 16 21:49:14.065947 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.065920 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ngkgc" Sep 16 21:49:14.075326 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.075303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmj2b" Sep 16 21:49:14.082035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.082014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:14.091779 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.091761 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w5lqw" Sep 16 21:49:14.100602 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.100580 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jnszv" Sep 16 21:49:14.108217 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.108198 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hd65k" Sep 16 21:49:14.371512 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.371416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:14.371512 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.371463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:14.371753 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.371595 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:14.371753 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.371610 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:14.371753 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.371668 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:15.371651187 +0000 UTC m=+3.989014049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:14.371753 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.371684 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:15.371677747 +0000 UTC m=+3.989040586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:14.472235 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.472195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:14.472421 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.472358 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:14.472421 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.472379 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:14.472421 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.472389 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:14.472605 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:14.472461 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:15.472441843 +0000 UTC m=+4.089804703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:14.787417 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.787339 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 21:44:13 +0000 UTC" deadline="2028-02-18 20:10:01.575831062 +0000 UTC" Sep 16 21:49:14.787417 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:14.787372 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12478h20m46.788463281s" Sep 16 21:49:14.939376 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.939350 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ba37ea_2c67_4471_8c7e_47cbda4e4753.slice/crio-b1c15b52ff67283a856968ce3cccb3cc7ea1b50e303e27c3d832927a7c2c09f9 WatchSource:0}: Error finding container b1c15b52ff67283a856968ce3cccb3cc7ea1b50e303e27c3d832927a7c2c09f9: Status 404 returned error can't find the container with id b1c15b52ff67283a856968ce3cccb3cc7ea1b50e303e27c3d832927a7c2c09f9 Sep 16 21:49:14.950095 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.950070 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0d1bde_1bc1_4d19_9cf0_598e1c127756.slice/crio-59a55b5a0592e4b5948e532edef75f912feca5d670aa418c2798f335e742ca1b WatchSource:0}: Error finding container 59a55b5a0592e4b5948e532edef75f912feca5d670aa418c2798f335e742ca1b: Status 404 returned error can't find the container with id 59a55b5a0592e4b5948e532edef75f912feca5d670aa418c2798f335e742ca1b Sep 16 21:49:14.958809 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.958581 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42913e30_c690_4951_94f5_6ec37cee6572.slice/crio-5bc0e7d1ad873ca34b0d3491dd699fba41bdfa77b3dd892d918004c7c8592361 WatchSource:0}: Error finding container 5bc0e7d1ad873ca34b0d3491dd699fba41bdfa77b3dd892d918004c7c8592361: Status 404 returned error can't find the container with id 5bc0e7d1ad873ca34b0d3491dd699fba41bdfa77b3dd892d918004c7c8592361 Sep 16 21:49:14.961155 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.960937 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554c602e_8d33_486b_88f8_cd67717ffc0b.slice/crio-6b66ec4828a131aac02b49f1a17ab7ad2a71dbb17354ba17db5774fefa70e466 WatchSource:0}: Error finding container 6b66ec4828a131aac02b49f1a17ab7ad2a71dbb17354ba17db5774fefa70e466: Status 404 returned error can't find the container with id 6b66ec4828a131aac02b49f1a17ab7ad2a71dbb17354ba17db5774fefa70e466 Sep 16 21:49:14.961864 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.961847 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ddf3a2_e69f_4a4a_be18_189741792a27.slice/crio-8aae7b0bbb49d7c7ec48d032eb2c7836fd910543cedcae9b6a16dd37f422d648 WatchSource:0}: Error finding container 8aae7b0bbb49d7c7ec48d032eb2c7836fd910543cedcae9b6a16dd37f422d648: Status 404 returned error can't find the container with id 8aae7b0bbb49d7c7ec48d032eb2c7836fd910543cedcae9b6a16dd37f422d648 Sep 16 21:49:14.963281 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.962957 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d17bf83_68f1_4996_acf8_cf9cc688ac9b.slice/crio-6ef779284e5a84d3bc56aeabae1bf28ac2a40acf98459f8628eafe0c00a74bf0 WatchSource:0}: Error finding container 6ef779284e5a84d3bc56aeabae1bf28ac2a40acf98459f8628eafe0c00a74bf0: Status 404 returned error can't find the container with id 6ef779284e5a84d3bc56aeabae1bf28ac2a40acf98459f8628eafe0c00a74bf0 Sep 16 21:49:14.965000 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:14.964808 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c0257e_db92_46d2_a4e7_24b601504022.slice/crio-0738f02487c799424e5065da95019e6ca5bc45642daf0c8b6fddb5e0cd48cb94 WatchSource:0}: Error finding container 0738f02487c799424e5065da95019e6ca5bc45642daf0c8b6fddb5e0cd48cb94: Status 404 returned error can't find the container with id 0738f02487c799424e5065da95019e6ca5bc45642daf0c8b6fddb5e0cd48cb94 Sep 16 21:49:15.378519 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.378481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:15.378711 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.378541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:15.378785 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.378723 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:15.378838 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.378793 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:17.378770662 +0000 UTC m=+5.996133518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:15.379082 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.378991 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:15.379082 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.379057 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:17.379040538 +0000 UTC m=+5.996403391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:15.479112 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.479057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:15.479303 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.479261 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:15.479303 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.479286 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:15.479303 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.479300 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:15.479486 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.479363 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:17.4793425 +0000 UTC m=+6.096705352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:15.788522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.788380 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 21:44:13 +0000 UTC" deadline="2028-02-22 19:41:12.144388894 +0000 UTC" Sep 16 21:49:15.788522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.788444 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12573h51m56.355949653s" Sep 16 21:49:15.883736 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.882842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:15.883736 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.882982 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:15.883736 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.883411 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:15.883736 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.883531 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:15.883736 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.883595 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:15.883736 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:15.883666 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:15.906835 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.906802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9zll6" event={"ID":"db0d1bde-1bc1-4d19-9cf0-598e1c127756","Type":"ContainerStarted","Data":"59a55b5a0592e4b5948e532edef75f912feca5d670aa418c2798f335e742ca1b"} Sep 16 21:49:15.912608 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.912571 2575 generic.go:356] "Generic (PLEG): container finished" podID="9739dcdafac449dab20c394bd816ec36" containerID="762eafd413bb4777af0ada54fed231f657dadf7260c25e6c68c2395d0ec17ba4" exitCode=0 Sep 16 21:49:15.913191 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.913167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" event={"ID":"9739dcdafac449dab20c394bd816ec36","Type":"ContainerDied","Data":"762eafd413bb4777af0ada54fed231f657dadf7260c25e6c68c2395d0ec17ba4"} Sep 16 21:49:15.929445 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.929418 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerStarted","Data":"0738f02487c799424e5065da95019e6ca5bc45642daf0c8b6fddb5e0cd48cb94"} Sep 16 21:49:15.931991 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.931841 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hd65k" event={"ID":"7d17bf83-68f1-4996-acf8-cf9cc688ac9b","Type":"ContainerStarted","Data":"6ef779284e5a84d3bc56aeabae1bf28ac2a40acf98459f8628eafe0c00a74bf0"} Sep 16 21:49:15.936711 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.936683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmj2b" event={"ID":"554c602e-8d33-486b-88f8-cd67717ffc0b","Type":"ContainerStarted","Data":"6b66ec4828a131aac02b49f1a17ab7ad2a71dbb17354ba17db5774fefa70e466"} Sep 16 21:49:15.942285 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.942128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w5lqw" event={"ID":"c198f991-41aa-4b51-88d4-eafb5aef8848","Type":"ContainerStarted","Data":"a206eb4c5316529a943e4b150930a7dc07854a04ecfc32cdb7cd6d580b5497ef"} Sep 16 21:49:15.946507 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.946420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnszv" event={"ID":"8e0af835-f817-433f-adbe-6b1c5afd2279","Type":"ContainerStarted","Data":"de26258cc8f6f81d117496b30c929283aacb3c4a626eeb5004bb9651a680c83d"} Sep 16 21:49:15.972004 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.971971 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ngkgc" event={"ID":"80ba37ea-2c67-4471-8c7e-47cbda4e4753","Type":"ContainerStarted","Data":"b1c15b52ff67283a856968ce3cccb3cc7ea1b50e303e27c3d832927a7c2c09f9"} Sep 16 21:49:15.983651 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:15.982719 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" event={"ID":"120b065a204276bba7b5eb34956aed54","Type":"ContainerStarted","Data":"eb407ab7a005f5c4a819646013c427cf99741c2117e5cceec558919ee23d3cf2"} Sep 16 21:49:16.007339 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:16.007261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" event={"ID":"a1ddf3a2-e69f-4a4a-be18-189741792a27","Type":"ContainerStarted","Data":"8aae7b0bbb49d7c7ec48d032eb2c7836fd910543cedcae9b6a16dd37f422d648"} Sep 16 21:49:16.015889 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:16.015855 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"5bc0e7d1ad873ca34b0d3491dd699fba41bdfa77b3dd892d918004c7c8592361"} Sep 16 21:49:17.034252 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.034160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" event={"ID":"9739dcdafac449dab20c394bd816ec36","Type":"ContainerStarted","Data":"a2763f0ce180f058347527d4c0c72c7f6b9ccaa832be6c26846a0d9b50014a8a"} Sep 16 21:49:17.051483 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.051053 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-168.ec2.internal" podStartSLOduration=4.051033005 podStartE2EDuration="4.051033005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:15.997184478 +0000 UTC m=+4.614547340" watchObservedRunningTime="2026-09-16 21:49:17.051033005 +0000 UTC m=+5.668395865" Sep 16 21:49:17.396524 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.396436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:17.396524 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.396495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:17.396744 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.396632 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:17.396744 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.396693 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.396676068 +0000 UTC m=+10.014038927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:17.397116 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.397096 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:17.397221 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.397157 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.397139566 +0000 UTC m=+10.014502420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:17.498496 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.497860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:17.498496 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.498034 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:17.498496 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.498053 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:17.498496 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.498082 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:17.498496 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.498141 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.498121592 +0000 UTC m=+10.115484444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:17.882887 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.881967 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:17.882887 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.882139 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:17.882887 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.882534 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:17.882887 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.882641 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:17.882887 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:17.882692 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:17.882887 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:17.882757 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:19.881934 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:19.881901 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:19.882396 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:19.881996 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:19.882396 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:19.882185 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:19.882396 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:19.882277 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:19.882396 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:19.882305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:19.882396 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:19.882371 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:21.437898 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:21.437856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:21.438401 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:21.437920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:21.438401 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.438137 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:21.438401 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.438203 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:29.438183406 +0000 UTC m=+18.055546260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:21.438724 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.438697 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:21.438852 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.438780 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:29.438735385 +0000 UTC m=+18.056098425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:21.539367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:21.539314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:21.539527 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.539509 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:21.539527 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.539526 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:21.539606 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.539535 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:21.539606 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.539580 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:29.539566978 +0000 UTC m=+18.156929831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:21.881408 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:21.880715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:21.881408 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.880831 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:21.881408 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:21.881228 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:21.881408 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.881311 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:21.881872 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:21.881756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:21.881872 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:21.881845 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:23.880469 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:23.879754 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:23.880469 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:23.879886 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:23.880469 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:23.880288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:23.880469 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:23.880360 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:23.880469 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:23.880400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:23.880469 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:23.880440 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:25.880122 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:25.880039 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:25.880122 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:25.880091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:25.880577 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:25.880040 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:25.880577 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:25.880190 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:25.880577 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:25.880292 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:25.880577 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:25.880370 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:27.880400 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:27.879885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:27.880400 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:27.880029 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:27.880400 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:27.880052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:27.880400 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:27.880132 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:27.880400 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:27.880229 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:27.880400 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:27.880324 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:29.498869 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:29.498786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:29.498869 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:29.498852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:29.499376 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.498946 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:29.499376 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.499006 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:29.499376 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.499033 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:45.499012439 +0000 UTC m=+34.116375295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:29.499376 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.499060 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:49:45.499041522 +0000 UTC m=+34.116404361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:29.599504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:29.599467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:29.599684 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.599602 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:29.599684 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.599621 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:29.599684 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.599634 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:29.599815 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.599704 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:45.599684051 +0000 UTC m=+34.217046910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:29.880369 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:29.880282 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:29.880529 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.880419 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:29.880529 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:29.880282 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:29.880529 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.880502 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:29.880529 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:29.880283 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:29.880741 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:29.880578 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:31.880523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:31.880492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:31.880919 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:31.880585 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:31.880919 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:31.880885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:31.881002 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:31.880961 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:31.881115 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:31.881092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:31.881243 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:31.881171 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:33.068799 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.068493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"1e883b0555375feb3c3bcd72319d46609cdb4a6d9afa33857aeb6934e43446ec"} Sep 16 21:49:33.069154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.068906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"4f750876b7395b33af2728169072bfdaf3d9a9e15cb5d6c5c09366af3440bda2"} Sep 16 21:49:33.070154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.070039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9zll6" event={"ID":"db0d1bde-1bc1-4d19-9cf0-598e1c127756","Type":"ContainerStarted","Data":"7c40a631a17ed788d0d794cb6287214949f31f1159d43dc02c216224c3653127"} Sep 16 21:49:33.071605 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.071582 2575 generic.go:356] "Generic (PLEG): container finished" podID="03c0257e-db92-46d2-a4e7-24b601504022" containerID="87bb919268344371e95c6eaa28ecef16bf58b093eb108b17b84ef3d5b7488e0f" exitCode=0 Sep 16 21:49:33.071695 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.071650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerDied","Data":"87bb919268344371e95c6eaa28ecef16bf58b093eb108b17b84ef3d5b7488e0f"} Sep 16 21:49:33.073394 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.073371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hd65k" event={"ID":"7d17bf83-68f1-4996-acf8-cf9cc688ac9b","Type":"ContainerStarted","Data":"bc5684deaf6f60348d3bc1b4f5d97db0b9e2a39f5613667380ed01bfb74d3c41"} Sep 16 21:49:33.075364 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.075163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmj2b" event={"ID":"554c602e-8d33-486b-88f8-cd67717ffc0b","Type":"ContainerStarted","Data":"4996fbaf31a4da1a3ea2bdb28ff85ba7381b44bb009af94e51cf4fa45b33f31b"} Sep 16 21:49:33.076895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.076874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jnszv" event={"ID":"8e0af835-f817-433f-adbe-6b1c5afd2279","Type":"ContainerStarted","Data":"6468a5fff0578c7efd146342253bb951eaaa79a7b9160c6b3b6815dea38e9064"} Sep 16 21:49:33.078983 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.078950 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ngkgc" event={"ID":"80ba37ea-2c67-4471-8c7e-47cbda4e4753","Type":"ContainerStarted","Data":"9dcb1a71419a1720cb71cb1d29704a3427fa4590bb32b9bd348dcb9f4b00ccfa"} Sep 16 21:49:33.080805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.080786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" event={"ID":"a1ddf3a2-e69f-4a4a-be18-189741792a27","Type":"ContainerStarted","Data":"98cc70390ecc55f137c8431eaef5f15ff3f9dd33d5164aa99df783b57aa4bc0d"} Sep 16 21:49:33.083492 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.083448 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9zll6" podStartSLOduration=6.808328604 podStartE2EDuration="21.083437015s" totalImagesPullingTime="14.275108411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:33.082884125 +0000 UTC m=+21.700246983" watchObservedRunningTime="2026-09-16 21:49:33.083437015 +0000 UTC m=+21.700799873" Sep 16 21:49:33.083618 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.083599 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-168.ec2.internal" podStartSLOduration=20.083594005 podStartE2EDuration="20.083594005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:17.051438917 +0000 UTC m=+5.668801778" watchObservedRunningTime="2026-09-16 21:49:33.083594005 +0000 UTC m=+21.700956864" Sep 16 21:49:33.097956 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.097917 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ngkgc" podStartSLOduration=6.815287736 podStartE2EDuration="21.097902456s" totalImagesPullingTime="14.28261472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:33.097812239 +0000 UTC m=+21.715175109" watchObservedRunningTime="2026-09-16 21:49:33.097902456 +0000 UTC m=+21.715265333" Sep 16 21:49:33.113026 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.112985 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmj2b" podStartSLOduration=3.256810309 podStartE2EDuration="21.112972622s" totalImagesPullingTime="17.856162313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:33.112445701 +0000 UTC m=+21.729808559" watchObservedRunningTime="2026-09-16 21:49:33.112972622 +0000 UTC m=+21.730335481" Sep 16 21:49:33.164039 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.163995 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jnszv" podStartSLOduration=3.351170993 podStartE2EDuration="21.16397577s" totalImagesPullingTime="17.812804777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:33.14927125 +0000 UTC m=+21.766634110" watchObservedRunningTime="2026-09-16 21:49:33.16397577 +0000 UTC m=+21.781338631" Sep 16 21:49:33.164174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.164119 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hd65k" podStartSLOduration=3.3627431039999998 podStartE2EDuration="21.164113443s" totalImagesPullingTime="17.801370339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:33.163543971 +0000 UTC m=+21.780906857" watchObservedRunningTime="2026-09-16 21:49:33.164113443 +0000 UTC m=+21.781476302" Sep 16 21:49:33.172866 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.172840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:33.231690 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.231663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:33.281814 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.281789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:33.880635 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.880607 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:33.880635 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.880634 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:33.880876 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:33.880647 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:33.880876 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:33.880720 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:33.880876 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:33.880851 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:33.881032 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:33.881016 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:34.086491 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.086456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"ccfc8a7f13592d2fb090fe62bb7bf6d4ffe747bdbdbb3beb196f38f59524d223"} Sep 16 21:49:34.087251 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.086550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"4e62e19415064fc707799728c8200af2b1d13f41e0c471d6b60039137751d790"} Sep 16 21:49:34.087251 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.086598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"7c85f34fa62e8cb23d779e1badb19d1b65da838db9cc19c17b90675910ac0bcc"} Sep 16 21:49:34.087251 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.086644 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"d96d34d8a210c4af63a4c1668be4853f5465ecdaf0772a01a75f6bb65db29692"} Sep 16 21:49:34.313335 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.313309 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 21:49:34.828050 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.827847 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T21:49:34.313328108Z","UUID":"18a01e0b-2e87-4828-92b4-4e635d3af853","Handler":null,"Name":"","Endpoint":""} Sep 16 21:49:34.829915 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.829894 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 21:49:34.830046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:34.829929 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 21:49:35.091343 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.090816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w5lqw" event={"ID":"c198f991-41aa-4b51-88d4-eafb5aef8848","Type":"ContainerStarted","Data":"551ba44ad6d032a868ce82818c38722005d68f0f869c2a4cec32bef0ac0ced3d"} Sep 16 21:49:35.093091 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.093043 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" event={"ID":"a1ddf3a2-e69f-4a4a-be18-189741792a27","Type":"ContainerStarted","Data":"4feed876aa86c01ae4511d5a7eb488afaf27325ea3104a1e659090b8ce0888ba"} Sep 16 21:49:35.105364 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.105306 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w5lqw" podStartSLOduration=5.294016928 podStartE2EDuration="23.105287899s" totalImagesPullingTime="17.811270971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:35.104261866 +0000 UTC m=+23.721624726" watchObservedRunningTime="2026-09-16 21:49:35.105287899 +0000 UTC m=+23.722650762" Sep 16 21:49:35.221787 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.221734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:35.274712 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.274685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:35.447689 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.447659 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:35.448447 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.448426 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:35.880240 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.880162 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:35.880240 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.880207 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:35.880410 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:35.880306 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:35.880410 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:35.880340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:35.880475 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:35.880428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:35.880557 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:35.880536 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:36.097705 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:36.097667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" event={"ID":"a1ddf3a2-e69f-4a4a-be18-189741792a27","Type":"ContainerStarted","Data":"9af78d309754a44f8ccd8b8fa51bc2beec53d56055963829dd704a6425628ff9"} Sep 16 21:49:36.101627 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:36.101598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"2a8ecb1c9b562e49e8437f2320a4c0dfe62888a8a39cc54d918cfdac2d00f226"} Sep 16 21:49:36.102003 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:36.101988 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:36.102441 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:36.102422 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9zll6" Sep 16 21:49:36.113672 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:36.113623 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dql54" podStartSLOduration=3.960095958 podStartE2EDuration="24.113609546s" totalImagesPullingTime="20.153513588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:36.113332996 +0000 UTC m=+24.730695856" watchObservedRunningTime="2026-09-16 21:49:36.113609546 +0000 UTC m=+24.730972407" Sep 16 21:49:36.168820 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:36.168745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:37.880079 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:37.879829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:37.880458 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:37.879828 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:37.880458 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:37.880188 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:37.880458 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:37.879863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:37.880458 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:37.880262 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:37.880458 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:37.880325 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:38.108154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.108078 2575 generic.go:356] "Generic (PLEG): container finished" podID="03c0257e-db92-46d2-a4e7-24b601504022" containerID="b8bc2eb500d1fe11b99cf5e1de03bba300e2fa62f4ad2adab67fd8084593650a" exitCode=0 Sep 16 21:49:38.108154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.108119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerDied","Data":"b8bc2eb500d1fe11b99cf5e1de03bba300e2fa62f4ad2adab67fd8084593650a"} Sep 16 21:49:38.112211 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.112185 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" event={"ID":"42913e30-c690-4951-94f5-6ec37cee6572","Type":"ContainerStarted","Data":"e1f1843a625ce3c33959ffb3ca53b6e7715faaa656296de6d2738c060f40b831"} Sep 16 21:49:38.112457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.112435 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:38.112457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.112508 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:38.127880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.127858 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:38.128000 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.127949 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:38.152704 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:38.152663 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" podStartSLOduration=8.289517313 podStartE2EDuration="26.152648833s" totalImagesPullingTime="17.86313152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:38.15249451 +0000 UTC m=+26.769857368" watchObservedRunningTime="2026-09-16 21:49:38.152648833 +0000 UTC m=+26.770011693" Sep 16 21:49:39.114185 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.114007 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 21:49:39.243623 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.243589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:39.339417 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.339384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:39.485273 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.485200 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wls8"] Sep 16 21:49:39.485423 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.485295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:39.485423 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:39.485375 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:39.488571 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.488542 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wvmvr"] Sep 16 21:49:39.488704 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.488655 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:39.488770 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:39.488753 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:39.489185 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.489160 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxjg2"] Sep 16 21:49:39.489327 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:39.489253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:39.489405 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:39.489344 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:40.118082 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:40.118029 2575 generic.go:356] "Generic (PLEG): container finished" podID="03c0257e-db92-46d2-a4e7-24b601504022" containerID="83a0b3a23bd1470b00d2bbc0970ceaed73bfcf9d8ad2af4323b0933fdeced304" exitCode=0 Sep 16 21:49:40.118766 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:40.118106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerDied","Data":"83a0b3a23bd1470b00d2bbc0970ceaed73bfcf9d8ad2af4323b0933fdeced304"} Sep 16 21:49:40.118766 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:40.118332 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 21:49:40.879819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:40.879787 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:40.880001 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:40.879960 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:40.880096 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:40.880022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:40.880160 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:40.880142 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:41.881535 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:41.881452 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:41.882105 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:41.881570 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:42.125141 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.124910 2575 generic.go:356] "Generic (PLEG): container finished" podID="03c0257e-db92-46d2-a4e7-24b601504022" containerID="74e1935ddaf707d63f3f4a7cfcb4d1275fd1d9731a1f8f7541f371810038453a" exitCode=0 Sep 16 21:49:42.125295 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.124989 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerDied","Data":"74e1935ddaf707d63f3f4a7cfcb4d1275fd1d9731a1f8f7541f371810038453a"} Sep 16 21:49:42.276388 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.276300 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:49:42.276558 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.276546 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 21:49:42.298243 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.298192 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" podUID="42913e30-c690-4951-94f5-6ec37cee6572" containerName="ovnkube-controller" probeResult="failure" output="" Sep 16 21:49:42.308820 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.308780 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" podUID="42913e30-c690-4951-94f5-6ec37cee6572" containerName="ovnkube-controller" probeResult="failure" output="" Sep 16 21:49:42.879589 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.879544 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:42.879589 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:42.879569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:42.879869 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:42.879668 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:42.879869 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:42.879840 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:43.298434 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:43.298361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:43.349189 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:43.349153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:43.879920 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:43.879872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:43.880122 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:43.880021 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxjg2" podUID="b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854" Sep 16 21:49:44.817815 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:44.817776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:44.867347 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:44.867313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:44.880397 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:44.880371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:44.880569 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:44.880489 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:49:44.880569 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:44.880548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:44.880683 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:44.880644 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wls8" podUID="593ba305-2eaf-4f74-830d-00b910be26a2" Sep 16 21:49:45.519368 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.519327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:45.519531 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.519382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:45.519531 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.519494 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:45.519531 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.519498 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:45.519647 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.519554 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:50:17.519538654 +0000 UTC m=+66.136901490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 21:49:45.519647 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.519567 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret podName:593ba305-2eaf-4f74-830d-00b910be26a2 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:17.51956112 +0000 UTC m=+66.136923957 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret") pod "global-pull-secret-syncer-6wls8" (UID: "593ba305-2eaf-4f74-830d-00b910be26a2") : object "kube-system"/"original-pull-secret" not registered Sep 16 21:49:45.620794 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.620762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:45.620954 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.620910 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 21:49:45.620954 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.620932 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 21:49:45.620954 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.620944 2575 projected.go:196] Error preparing data for projected volume kube-api-access-lbb57 for pod openshift-network-diagnostics/network-check-target-bxjg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:45.621051 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.621004 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57 podName:b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:17.620986365 +0000 UTC m=+66.238349220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbb57" (UniqueName: "kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57") pod "network-check-target-bxjg2" (UID: "b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 21:49:45.690368 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.690340 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-168.ec2.internal" event="NodeReady" Sep 16 21:49:45.690551 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.690494 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 21:49:45.739949 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.739911 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q7g62"] Sep 16 21:49:45.742876 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.742857 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mktwb"] Sep 16 21:49:45.743005 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.742985 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.744925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.744905 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.745702 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.745685 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 21:49:45.746214 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.745981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pj46n\"" Sep 16 21:49:45.746399 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.746374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 21:49:45.750144 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.748141 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 21:49:45.750144 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.748324 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 21:49:45.750144 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.748748 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7xfr\"" Sep 16 21:49:45.750144 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.748748 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 21:49:45.751192 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.751171 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mktwb"] Sep 16 21:49:45.753868 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.753847 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q7g62"] Sep 16 21:49:45.822486 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.822448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2913d3f1-05b2-4968-b68f-93d666b2ed82-tmp-dir\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.822880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.822495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2913d3f1-05b2-4968-b68f-93d666b2ed82-config-volume\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.822880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.822511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.822880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.822609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01a1f86b-e86c-4c85-af68-e9b2327015b2-cert\") pod \"ingress-canary-mktwb\" (UID: \"01a1f86b-e86c-4c85-af68-e9b2327015b2\") " pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.822880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.822638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlp7m\" (UniqueName: \"kubernetes.io/projected/01a1f86b-e86c-4c85-af68-e9b2327015b2-kube-api-access-tlp7m\") pod \"ingress-canary-mktwb\" (UID: \"01a1f86b-e86c-4c85-af68-e9b2327015b2\") " pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.822880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.822663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvwb\" (UniqueName: \"kubernetes.io/projected/2913d3f1-05b2-4968-b68f-93d666b2ed82-kube-api-access-5cvwb\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.845377 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.845312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:45.880441 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.880401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:49:45.883098 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.883044 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 21:49:45.883219 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.883188 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 21:49:45.883270 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.883216 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pd2w2\"" Sep 16 21:49:45.897967 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.897938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:45.923988 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.923959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2913d3f1-05b2-4968-b68f-93d666b2ed82-tmp-dir\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.924229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.923996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2913d3f1-05b2-4968-b68f-93d666b2ed82-config-volume\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.924229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.924021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.924229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.924127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01a1f86b-e86c-4c85-af68-e9b2327015b2-cert\") pod \"ingress-canary-mktwb\" (UID: \"01a1f86b-e86c-4c85-af68-e9b2327015b2\") " pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.924229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.924166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlp7m\" (UniqueName: \"kubernetes.io/projected/01a1f86b-e86c-4c85-af68-e9b2327015b2-kube-api-access-tlp7m\") pod \"ingress-canary-mktwb\" (UID: \"01a1f86b-e86c-4c85-af68-e9b2327015b2\") " pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.924229 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.924142 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:49:45.924229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.924194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvwb\" (UniqueName: \"kubernetes.io/projected/2913d3f1-05b2-4968-b68f-93d666b2ed82-kube-api-access-5cvwb\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.924515 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:45.924246 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.424225496 +0000 UTC m=+35.041588334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:49:45.924669 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.924645 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2913d3f1-05b2-4968-b68f-93d666b2ed82-config-volume\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.924754 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.924710 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2913d3f1-05b2-4968-b68f-93d666b2ed82-tmp-dir\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:45.928984 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.928962 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01a1f86b-e86c-4c85-af68-e9b2327015b2-cert\") pod \"ingress-canary-mktwb\" (UID: \"01a1f86b-e86c-4c85-af68-e9b2327015b2\") " pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.935017 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.934996 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlp7m\" (UniqueName: \"kubernetes.io/projected/01a1f86b-e86c-4c85-af68-e9b2327015b2-kube-api-access-tlp7m\") pod \"ingress-canary-mktwb\" (UID: \"01a1f86b-e86c-4c85-af68-e9b2327015b2\") " pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:45.935149 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:45.935001 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvwb\" (UniqueName: \"kubernetes.io/projected/2913d3f1-05b2-4968-b68f-93d666b2ed82-kube-api-access-5cvwb\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:46.066341 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.066304 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mktwb" Sep 16 21:49:46.427654 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.427429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:46.427805 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:46.427581 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:49:46.427805 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:46.427791 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:47.427771656 +0000 UTC m=+36.045134513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:49:46.508945 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.508796 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mktwb"] Sep 16 21:49:46.520943 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:49:46.520912 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a1f86b_e86c_4c85_af68_e9b2327015b2.slice/crio-b7fb3574880219b08a01583cdb5fbee5adfebb7af3898425bf28c99506745d58 WatchSource:0}: Error finding container b7fb3574880219b08a01583cdb5fbee5adfebb7af3898425bf28c99506745d58: Status 404 returned error can't find the container with id b7fb3574880219b08a01583cdb5fbee5adfebb7af3898425bf28c99506745d58 Sep 16 21:49:46.880524 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.880428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:49:46.880524 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.880482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:49:46.883150 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.883128 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cplt\"" Sep 16 21:49:46.883271 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.883128 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 21:49:46.884189 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:46.884174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 21:49:47.140496 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:47.140419 2575 generic.go:356] "Generic (PLEG): container finished" podID="03c0257e-db92-46d2-a4e7-24b601504022" containerID="2038bd9bbd12214a4372aa9b042e384ce658137408ad98ad07704472ab092cf6" exitCode=0 Sep 16 21:49:47.140668 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:47.140514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerDied","Data":"2038bd9bbd12214a4372aa9b042e384ce658137408ad98ad07704472ab092cf6"} Sep 16 21:49:47.141988 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:47.141965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mktwb" event={"ID":"01a1f86b-e86c-4c85-af68-e9b2327015b2","Type":"ContainerStarted","Data":"b7fb3574880219b08a01583cdb5fbee5adfebb7af3898425bf28c99506745d58"} Sep 16 21:49:47.435235 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:47.435145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:47.435406 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:47.435332 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:49:47.435501 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:47.435421 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:49.435399645 +0000 UTC m=+38.052762503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:49:48.148099 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:48.148045 2575 generic.go:356] "Generic (PLEG): container finished" podID="03c0257e-db92-46d2-a4e7-24b601504022" containerID="23fb3ffa3befdc12a0505b4ac82af82a7253ba31c06078ef9e9e5ea809954bf2" exitCode=0 Sep 16 21:49:48.148099 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:48.148101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerDied","Data":"23fb3ffa3befdc12a0505b4ac82af82a7253ba31c06078ef9e9e5ea809954bf2"} Sep 16 21:49:49.154107 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:49.154056 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" event={"ID":"03c0257e-db92-46d2-a4e7-24b601504022","Type":"ContainerStarted","Data":"57c267263df240b0049b853dd425644c58ae8a40a32f7c0842ae0782e3808da6"} Sep 16 21:49:49.178448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:49.178390 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bcfrs" podStartSLOduration=8.426216861 podStartE2EDuration="37.178374589s" totalImagesPullingTime="28.752157728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:49.176979818 +0000 UTC m=+37.794342677" watchObservedRunningTime="2026-09-16 21:49:49.178374589 +0000 UTC m=+37.795737447" Sep 16 21:49:49.300243 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:49.300151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:49.348416 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:49.348388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:49.450782 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:49.450741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:49.450944 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:49.450915 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:49:49.450997 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:49.450985 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:53.450968046 +0000 UTC m=+42.068330897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:49:50.158247 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:50.158207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mktwb" event={"ID":"01a1f86b-e86c-4c85-af68-e9b2327015b2","Type":"ContainerStarted","Data":"65296de1b92d4c2521c7cc4208b9a1cf29246a267e0783120f0c93c87b5939a8"} Sep 16 21:49:50.174264 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:50.174216 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mktwb" podStartSLOduration=2.596312374 podStartE2EDuration="5.174200999s" totalImagesPullingTime="2.577888625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:50.173942256 +0000 UTC m=+38.791305117" watchObservedRunningTime="2026-09-16 21:49:50.174200999 +0000 UTC m=+38.791563857" Sep 16 21:49:51.154697 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:51.154663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:51.206539 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:51.206506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:49:53.482177 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:49:53.482140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:49:53.482548 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:53.482300 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:49:53.482548 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:49:53.482372 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:01.482355035 +0000 UTC m=+50.099717872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:50:01.533704 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:01.533660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:50:01.534266 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:01.533852 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:50:01.534266 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:01.533935 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:17.533912479 +0000 UTC m=+66.151275328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:50:04.267785 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:04.267747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:04.315510 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:04.315473 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:12.308480 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:12.308443 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tplfl" Sep 16 21:50:12.411331 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:12.411291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:12.469297 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:12.469266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:12.517905 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:12.517870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:17.543713 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.543672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:50:17.544109 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.543721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:50:17.544109 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.543752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:50:17.544109 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:17.543839 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:50:17.544109 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:17.543925 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:50:49.543904195 +0000 UTC m=+98.161267056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:50:17.546573 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.546554 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 21:50:17.546722 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.546710 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 21:50:17.554324 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:17.554305 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 21:50:17.554385 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:17.554373 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:51:21.554354964 +0000 UTC m=+130.171717801 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : secret "metrics-daemon-secret" not found Sep 16 21:50:17.557332 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.557306 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593ba305-2eaf-4f74-830d-00b910be26a2-original-pull-secret\") pod \"global-pull-secret-syncer-6wls8\" (UID: \"593ba305-2eaf-4f74-830d-00b910be26a2\") " pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:50:17.644355 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.644313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:50:17.647436 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.647416 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 21:50:17.657969 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.657950 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 21:50:17.668519 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.668497 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbb57\" (UniqueName: \"kubernetes.io/projected/b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854-kube-api-access-lbb57\") pod \"network-check-target-bxjg2\" (UID: \"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854\") " pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:50:17.694173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.694151 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pd2w2\"" Sep 16 21:50:17.701997 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.701979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:50:17.794281 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.794226 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wls8" Sep 16 21:50:17.998745 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:17.998601 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxjg2"] Sep 16 21:50:18.001222 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:50:18.001198 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b8a4f4_ffff_475b_8f5b_ccfc18c1c854.slice/crio-46ddfb1b5995c96e5e51d5e22ed73503be3a85b33b6d4158b5716e75d999df58 WatchSource:0}: Error finding container 46ddfb1b5995c96e5e51d5e22ed73503be3a85b33b6d4158b5716e75d999df58: Status 404 returned error can't find the container with id 46ddfb1b5995c96e5e51d5e22ed73503be3a85b33b6d4158b5716e75d999df58 Sep 16 21:50:18.073237 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:18.073170 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wls8"] Sep 16 21:50:18.075900 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:50:18.075873 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593ba305_2eaf_4f74_830d_00b910be26a2.slice/crio-330bc8b882801bbcabae528db7314fe78bcb7165ca986220153aa0f42cf78528 WatchSource:0}: Error finding container 330bc8b882801bbcabae528db7314fe78bcb7165ca986220153aa0f42cf78528: Status 404 returned error can't find the container with id 330bc8b882801bbcabae528db7314fe78bcb7165ca986220153aa0f42cf78528 Sep 16 21:50:18.222828 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:18.222792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wls8" event={"ID":"593ba305-2eaf-4f74-830d-00b910be26a2","Type":"ContainerStarted","Data":"330bc8b882801bbcabae528db7314fe78bcb7165ca986220153aa0f42cf78528"} Sep 16 21:50:18.223896 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:18.223870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxjg2" event={"ID":"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854","Type":"ContainerStarted","Data":"46ddfb1b5995c96e5e51d5e22ed73503be3a85b33b6d4158b5716e75d999df58"} Sep 16 21:50:23.239305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:23.239267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wls8" event={"ID":"593ba305-2eaf-4f74-830d-00b910be26a2","Type":"ContainerStarted","Data":"63c766c654620c166dad92fc6e6c71af317b0ff105e9acafbdab7a4d17765366"} Sep 16 21:50:23.240804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:23.240780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxjg2" event={"ID":"b6b8a4f4-ffff-475b-8f5b-ccfc18c1c854","Type":"ContainerStarted","Data":"e9a035a7bae59e7e95cf0c8cfca5209a5469ccc7005154b3b9f401c104340d42"} Sep 16 21:50:23.240914 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:23.240903 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:50:23.253795 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:23.253754 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6wls8" podStartSLOduration=66.633342571 podStartE2EDuration="1m11.253736858s" totalImagesPullingTime="4.620394287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:50:23.253166608 +0000 UTC m=+71.870529468" watchObservedRunningTime="2026-09-16 21:50:23.253736858 +0000 UTC m=+71.871099708" Sep 16 21:50:23.267000 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:23.266959 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bxjg2" podStartSLOduration=66.573256253 podStartE2EDuration="1m11.26694914s" totalImagesPullingTime="4.693692887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:50:23.266519968 +0000 UTC m=+71.883882826" watchObservedRunningTime="2026-09-16 21:50:23.26694914 +0000 UTC m=+71.884311999" Sep 16 21:50:43.166453 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:43.166336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:43.214423 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:43.214397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:50:49.566506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:49.566445 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:50:49.566908 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:49.566608 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:50:49.566908 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:50:49.566690 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:51:53.566672774 +0000 UTC m=+162.184035612 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:50:54.245028 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:50:54.244999 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bxjg2" Sep 16 21:51:16.380179 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:51:16.380142 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:51:21.584413 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:51:21.584354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:51:21.584806 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:51:21.584491 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 21:51:21.584806 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:51:21.584567 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:53:23.584547892 +0000 UTC m=+252.201910751 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : secret "metrics-daemon-secret" not found Sep 16 21:51:48.759955 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:51:48.759912 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q7g62" podUID="2913d3f1-05b2-4968-b68f-93d666b2ed82" Sep 16 21:51:49.446764 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:51:49.446734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q7g62" Sep 16 21:51:49.889310 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:51:49.889271 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:51:53.600379 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:51:53.600323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:51:53.600862 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:51:53.600506 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 21:51:53.600862 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:51:53.600595 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls podName:2913d3f1-05b2-4968-b68f-93d666b2ed82 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:55.600571659 +0000 UTC m=+284.217934498 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls") pod "dns-default-q7g62" (UID: "2913d3f1-05b2-4968-b68f-93d666b2ed82") : secret "dns-default-metrics-tls" not found Sep 16 21:52:04.879804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:52:04.879723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:52:41.782901 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:52:41.782860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:13.018766 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.018734 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx"] Sep 16 21:53:13.020536 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.020520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" Sep 16 21:53:13.023506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.023479 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws"] Sep 16 21:53:13.024711 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.024691 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g6bd6\"" Sep 16 21:53:13.025008 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.024994 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dc98bc58f-s6q9m"] Sep 16 21:53:13.025140 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.025127 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.026646 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.026625 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.027744 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.027724 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8ktcd\"" Sep 16 21:53:13.029327 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.029309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 16 21:53:13.029407 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.029342 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 21:53:13.029407 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.029355 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 16 21:53:13.029407 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.029314 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 21:53:13.030418 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.030404 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 16 21:53:13.030499 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.030408 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 16 21:53:13.030828 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.030812 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9dzlw\"" Sep 16 21:53:13.032504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.032483 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 16 21:53:13.036110 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.036090 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 16 21:53:13.042687 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.042666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx"] Sep 16 21:53:13.046687 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.046666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws"] Sep 16 21:53:13.047704 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.047683 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc98bc58f-s6q9m"] Sep 16 21:53:13.114445 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.114409 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9"] Sep 16 21:53:13.116322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.116299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.118891 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.118863 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 16 21:53:13.118891 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.118874 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q7n85\"" Sep 16 21:53:13.118891 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.118882 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 16 21:53:13.119129 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.118934 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 16 21:53:13.119341 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.119315 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 16 21:53:13.121275 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.121256 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t"] Sep 16 21:53:13.123156 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.123135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.125865 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.125840 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 16 21:53:13.125865 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.125858 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 16 21:53:13.125984 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.125897 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8hmrz\"" Sep 16 21:53:13.125984 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.125905 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 16 21:53:13.125984 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.125861 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 16 21:53:13.128021 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5d3c5d-e8e5-43bc-99e6-850081f30628-ca-trust-extracted\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-certificates\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-bound-sa-token\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24732cb0-e397-49b0-80bd-ff99e0b6164b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.128138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dws9p\" (UniqueName: \"kubernetes.io/projected/24732cb0-e397-49b0-80bd-ff99e0b6164b-kube-api-access-dws9p\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-trusted-ca\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-installation-pull-secrets\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-image-registry-private-configuration\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcl5q\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-kube-api-access-bcl5q\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26twz\" (UniqueName: \"kubernetes.io/projected/b32cd969-7d34-4039-9e49-6993246a2c71-kube-api-access-26twz\") pod \"network-check-source-6f8b768455-f6sqx\" (UID: \"b32cd969-7d34-4039-9e49-6993246a2c71\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" Sep 16 21:53:13.128328 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.128278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.130400 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.130376 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9"] Sep 16 21:53:13.134315 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.134297 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t"] Sep 16 21:53:13.229255 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dws9p\" (UniqueName: \"kubernetes.io/projected/24732cb0-e397-49b0-80bd-ff99e0b6164b-kube-api-access-dws9p\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.229255 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4w8d\" (UniqueName: \"kubernetes.io/projected/4b2e3c69-6270-4b1d-901b-5c361018da4a-kube-api-access-q4w8d\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.229452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-trusted-ca\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.229452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b2e3c69-6270-4b1d-901b-5c361018da4a-serving-cert\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.229452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229355 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-installation-pull-secrets\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.229452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.229452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229420 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-image-registry-private-configuration\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.229452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcl5q\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-kube-api-access-bcl5q\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26twz\" (UniqueName: \"kubernetes.io/projected/b32cd969-7d34-4039-9e49-6993246a2c71-kube-api-access-26twz\") pod \"network-check-source-6f8b768455-f6sqx\" (UID: \"b32cd969-7d34-4039-9e49-6993246a2c71\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b2e3c69-6270-4b1d-901b-5c361018da4a-config\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6t9l\" (UniqueName: \"kubernetes.io/projected/461bd19e-9421-4cb1-9b1e-7c26bc656388-kube-api-access-b6t9l\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.229527 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.229595 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls podName:24732cb0-e397-49b0-80bd-ff99e0b6164b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:13.729575006 +0000 UTC m=+242.346937866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5srws" (UID: "24732cb0-e397-49b0-80bd-ff99e0b6164b") : secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/461bd19e-9421-4cb1-9b1e-7c26bc656388-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.229780 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5d3c5d-e8e5-43bc-99e6-850081f30628-ca-trust-extracted\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-certificates\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.229879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-bound-sa-token\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.229930 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.229943 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc98bc58f-s6q9m: secret "image-registry-tls" not found Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.229993 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls podName:8f5d3c5d-e8e5-43bc-99e6-850081f30628 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:13.729977217 +0000 UTC m=+242.347340068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls") pod "image-registry-7dc98bc58f-s6q9m" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628") : secret "image-registry-tls" not found Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.230019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24732cb0-e397-49b0-80bd-ff99e0b6164b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.230132 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.230058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/461bd19e-9421-4cb1-9b1e-7c26bc656388-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.230531 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.230148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5d3c5d-e8e5-43bc-99e6-850081f30628-ca-trust-extracted\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230531 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.230344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-trusted-ca\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230531 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.230469 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-certificates\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.230660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.230643 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/24732cb0-e397-49b0-80bd-ff99e0b6164b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.232561 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.232535 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-installation-pull-secrets\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.232677 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.232657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-image-registry-private-configuration\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.238191 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.238169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26twz\" (UniqueName: \"kubernetes.io/projected/b32cd969-7d34-4039-9e49-6993246a2c71-kube-api-access-26twz\") pod \"network-check-source-6f8b768455-f6sqx\" (UID: \"b32cd969-7d34-4039-9e49-6993246a2c71\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" Sep 16 21:53:13.238561 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.238543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dws9p\" (UniqueName: \"kubernetes.io/projected/24732cb0-e397-49b0-80bd-ff99e0b6164b-kube-api-access-dws9p\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.238726 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.238710 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-bound-sa-token\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.239293 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.239279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcl5q\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-kube-api-access-bcl5q\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.245403 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.245380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:13.301852 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.301775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:13.330151 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.330125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" Sep 16 21:53:13.331359 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/461bd19e-9421-4cb1-9b1e-7c26bc656388-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.331474 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4w8d\" (UniqueName: \"kubernetes.io/projected/4b2e3c69-6270-4b1d-901b-5c361018da4a-kube-api-access-q4w8d\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.331474 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b2e3c69-6270-4b1d-901b-5c361018da4a-serving-cert\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.331544 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b2e3c69-6270-4b1d-901b-5c361018da4a-config\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.331544 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6t9l\" (UniqueName: \"kubernetes.io/projected/461bd19e-9421-4cb1-9b1e-7c26bc656388-kube-api-access-b6t9l\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.331640 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/461bd19e-9421-4cb1-9b1e-7c26bc656388-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.331974 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.331952 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/461bd19e-9421-4cb1-9b1e-7c26bc656388-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.332100 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.332059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b2e3c69-6270-4b1d-901b-5c361018da4a-config\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.333863 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.333844 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/461bd19e-9421-4cb1-9b1e-7c26bc656388-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.334089 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.334051 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b2e3c69-6270-4b1d-901b-5c361018da4a-serving-cert\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.339699 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.339678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4w8d\" (UniqueName: \"kubernetes.io/projected/4b2e3c69-6270-4b1d-901b-5c361018da4a-kube-api-access-q4w8d\") pod \"service-ca-operator-cf7c776b7-ttnx9\" (UID: \"4b2e3c69-6270-4b1d-901b-5c361018da4a\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.339788 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.339772 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6t9l\" (UniqueName: \"kubernetes.io/projected/461bd19e-9421-4cb1-9b1e-7c26bc656388-kube-api-access-b6t9l\") pod \"kube-storage-version-migrator-operator-6c8f84f897-tv52t\" (UID: \"461bd19e-9421-4cb1-9b1e-7c26bc656388\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.425516 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.425482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" Sep 16 21:53:13.432213 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.432105 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" Sep 16 21:53:13.592715 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.592640 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx"] Sep 16 21:53:13.595576 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:13.595553 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32cd969_7d34_4039_9e49_6993246a2c71.slice/crio-6e63962342503d71ad2b68185653ee31946212dc253f3b95b7439214ad82b02a WatchSource:0}: Error finding container 6e63962342503d71ad2b68185653ee31946212dc253f3b95b7439214ad82b02a: Status 404 returned error can't find the container with id 6e63962342503d71ad2b68185653ee31946212dc253f3b95b7439214ad82b02a Sep 16 21:53:13.650621 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.650587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" event={"ID":"b32cd969-7d34-4039-9e49-6993246a2c71","Type":"ContainerStarted","Data":"dced9abb2efc847dd5ad973eaa48fcde3fc9dcde14a749e8b68398bc2a7791e7"} Sep 16 21:53:13.650747 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.650634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" event={"ID":"b32cd969-7d34-4039-9e49-6993246a2c71","Type":"ContainerStarted","Data":"6e63962342503d71ad2b68185653ee31946212dc253f3b95b7439214ad82b02a"} Sep 16 21:53:13.664465 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.664417 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-f6sqx" podStartSLOduration=0.66439609 podStartE2EDuration="664.39609ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:13.664096398 +0000 UTC m=+242.281459257" watchObservedRunningTime="2026-09-16 21:53:13.66439609 +0000 UTC m=+242.281758949" Sep 16 21:53:13.709193 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.709133 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9"] Sep 16 21:53:13.711199 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:13.711173 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2e3c69_6270_4b1d_901b_5c361018da4a.slice/crio-44ff98c078b5589825fa164f3c399a08a15c77e72fc587a2ecf379cf5379966c WatchSource:0}: Error finding container 44ff98c078b5589825fa164f3c399a08a15c77e72fc587a2ecf379cf5379966c: Status 404 returned error can't find the container with id 44ff98c078b5589825fa164f3c399a08a15c77e72fc587a2ecf379cf5379966c Sep 16 21:53:13.722867 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.722826 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t"] Sep 16 21:53:13.728709 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:13.728680 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461bd19e_9421_4cb1_9b1e_7c26bc656388.slice/crio-832e94f54fa61d605387cb5f82c333ec2fab41b1ee8eabb8e3392a5aa6403088 WatchSource:0}: Error finding container 832e94f54fa61d605387cb5f82c333ec2fab41b1ee8eabb8e3392a5aa6403088: Status 404 returned error can't find the container with id 832e94f54fa61d605387cb5f82c333ec2fab41b1ee8eabb8e3392a5aa6403088 Sep 16 21:53:13.734614 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.734588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:13.734703 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:13.734682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:13.734752 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.734729 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 21:53:13.734752 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.734744 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc98bc58f-s6q9m: secret "image-registry-tls" not found Sep 16 21:53:13.734854 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.734799 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls podName:8f5d3c5d-e8e5-43bc-99e6-850081f30628 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:14.73478117 +0000 UTC m=+243.352144010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls") pod "image-registry-7dc98bc58f-s6q9m" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628") : secret "image-registry-tls" not found Sep 16 21:53:13.734854 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.734842 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:13.734954 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:13.734909 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls podName:24732cb0-e397-49b0-80bd-ff99e0b6164b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:14.734890731 +0000 UTC m=+243.352253582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5srws" (UID: "24732cb0-e397-49b0-80bd-ff99e0b6164b") : secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:14.655935 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:14.655639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" event={"ID":"461bd19e-9421-4cb1-9b1e-7c26bc656388","Type":"ContainerStarted","Data":"832e94f54fa61d605387cb5f82c333ec2fab41b1ee8eabb8e3392a5aa6403088"} Sep 16 21:53:14.657190 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:14.657138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" event={"ID":"4b2e3c69-6270-4b1d-901b-5c361018da4a","Type":"ContainerStarted","Data":"44ff98c078b5589825fa164f3c399a08a15c77e72fc587a2ecf379cf5379966c"} Sep 16 21:53:14.743503 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:14.743460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:14.743688 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:14.743555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:14.743755 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:14.743709 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 21:53:14.743755 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:14.743722 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc98bc58f-s6q9m: secret "image-registry-tls" not found Sep 16 21:53:14.743855 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:14.743771 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls podName:8f5d3c5d-e8e5-43bc-99e6-850081f30628 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:16.743757479 +0000 UTC m=+245.361120317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls") pod "image-registry-7dc98bc58f-s6q9m" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628") : secret "image-registry-tls" not found Sep 16 21:53:14.744081 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:14.744023 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:14.744192 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:14.744112 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls podName:24732cb0-e397-49b0-80bd-ff99e0b6164b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:16.744093768 +0000 UTC m=+245.361456608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5srws" (UID: "24732cb0-e397-49b0-80bd-ff99e0b6164b") : secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:14.761143 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:14.761110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:16.664262 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:16.664219 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" event={"ID":"4b2e3c69-6270-4b1d-901b-5c361018da4a","Type":"ContainerStarted","Data":"1563df51d8cfca491646dc8fc12139572670929f743cf17140e8637701f22ae3"} Sep 16 21:53:16.665768 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:16.665736 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" event={"ID":"461bd19e-9421-4cb1-9b1e-7c26bc656388","Type":"ContainerStarted","Data":"dc1e0225e2a3aa9f0e85dcd8582f462a180aba6eebdd00de1e118b98ed57f694"} Sep 16 21:53:16.680421 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:16.680373 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" podStartSLOduration=1.12403914 podStartE2EDuration="3.680356564s" totalImagesPullingTime="2.556317424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:16.680298329 +0000 UTC m=+245.297661194" watchObservedRunningTime="2026-09-16 21:53:16.680356564 +0000 UTC m=+245.297719425" Sep 16 21:53:16.698587 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:16.698534 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" podStartSLOduration=1.160832389 podStartE2EDuration="3.698514672s" totalImagesPullingTime="2.537682283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:16.697924853 +0000 UTC m=+245.315287713" watchObservedRunningTime="2026-09-16 21:53:16.698514672 +0000 UTC m=+245.315877533" Sep 16 21:53:16.759827 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:16.759790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:16.759981 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:16.759967 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 21:53:16.760078 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:16.759985 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc98bc58f-s6q9m: secret "image-registry-tls" not found Sep 16 21:53:16.760078 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:16.760043 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls podName:8f5d3c5d-e8e5-43bc-99e6-850081f30628 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:20.760024639 +0000 UTC m=+249.377387496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls") pod "image-registry-7dc98bc58f-s6q9m" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628") : secret "image-registry-tls" not found Sep 16 21:53:16.760414 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:16.760386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:16.760510 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:16.760498 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:16.760562 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:16.760553 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls podName:24732cb0-e397-49b0-80bd-ff99e0b6164b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:20.76053681 +0000 UTC m=+249.377899653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5srws" (UID: "24732cb0-e397-49b0-80bd-ff99e0b6164b") : secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:17.675735 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:17.675615 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:17.774842 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:17.774808 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:17.875375 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:17.875345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:18.023056 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.022975 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hzqvm"] Sep 16 21:53:18.025173 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.025151 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.027369 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.027353 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 21:53:18.027455 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.027438 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 21:53:18.027616 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.027600 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pbdm9\"" Sep 16 21:53:18.027697 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.027681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 21:53:18.028901 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.028881 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 21:53:18.034838 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.034804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:18.035133 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.035114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzqvm"] Sep 16 21:53:18.070288 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.070262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/848730f9-aef7-4f05-8e71-cea08eff0779-data-volume\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.070434 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.070312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/848730f9-aef7-4f05-8e71-cea08eff0779-crio-socket\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.070434 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.070353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbfxp\" (UniqueName: \"kubernetes.io/projected/848730f9-aef7-4f05-8e71-cea08eff0779-kube-api-access-lbfxp\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.070434 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.070376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.070434 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.070395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.091779 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.091748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:18.171598 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/848730f9-aef7-4f05-8e71-cea08eff0779-data-volume\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.171762 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/848730f9-aef7-4f05-8e71-cea08eff0779-crio-socket\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.171762 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/848730f9-aef7-4f05-8e71-cea08eff0779-crio-socket\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.171762 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbfxp\" (UniqueName: \"kubernetes.io/projected/848730f9-aef7-4f05-8e71-cea08eff0779-kube-api-access-lbfxp\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.171762 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.171948 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.171948 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.171866 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 21:53:18.171948 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.171878 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 21:53:18.171948 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.171937 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:18.671918302 +0000 UTC m=+247.289281156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : secret "insights-runtime-extractor-tls" not found Sep 16 21:53:18.172152 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.171939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/848730f9-aef7-4f05-8e71-cea08eff0779-data-volume\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.172152 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.171950 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:18.671943463 +0000 UTC m=+247.289306300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : configmap "kube-rbac-proxy" not found Sep 16 21:53:18.180823 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.180800 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbfxp\" (UniqueName: \"kubernetes.io/projected/848730f9-aef7-4f05-8e71-cea08eff0779-kube-api-access-lbfxp\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.528717 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.528685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:18.628852 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.628817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:18.675973 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.675949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.676449 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:18.675981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:18.676449 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.676103 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 21:53:18.676449 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.676148 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 21:53:18.676449 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.676188 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:19.676166292 +0000 UTC m=+248.293529144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : configmap "kube-rbac-proxy" not found Sep 16 21:53:18.676449 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:18.676208 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:19.676199394 +0000 UTC m=+248.293562230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : secret "insights-runtime-extractor-tls" not found Sep 16 21:53:19.683590 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:19.683555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:19.683590 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:19.683591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:19.684019 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:19.683690 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 21:53:19.684019 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:19.683697 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 21:53:19.684019 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:19.683751 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:21.683738101 +0000 UTC m=+250.301100937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : secret "insights-runtime-extractor-tls" not found Sep 16 21:53:19.684019 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:19.683764 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:21.68375778 +0000 UTC m=+250.301120616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : configmap "kube-rbac-proxy" not found Sep 16 21:53:19.789165 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:19.789129 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:20.124843 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.124804 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-s8snw"] Sep 16 21:53:20.127518 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.127499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.130252 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.130231 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 16 21:53:20.130343 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.130233 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 16 21:53:20.131469 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.131452 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 16 21:53:20.131620 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.131603 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9m2wj\"" Sep 16 21:53:20.131736 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.131719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 16 21:53:20.136754 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.136733 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-s8snw"] Sep 16 21:53:20.160958 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.160932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:20.188302 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.188279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h2pl\" (UniqueName: \"kubernetes.io/projected/6dfdf02c-b11f-4bb0-95a3-e88699da8852-kube-api-access-9h2pl\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.188407 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.188337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dfdf02c-b11f-4bb0-95a3-e88699da8852-signing-cabundle\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.188407 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.188381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dfdf02c-b11f-4bb0-95a3-e88699da8852-signing-key\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.208404 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.208381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:20.289422 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.289395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dfdf02c-b11f-4bb0-95a3-e88699da8852-signing-cabundle\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.289559 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.289454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dfdf02c-b11f-4bb0-95a3-e88699da8852-signing-key\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.289559 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.289497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h2pl\" (UniqueName: \"kubernetes.io/projected/6dfdf02c-b11f-4bb0-95a3-e88699da8852-kube-api-access-9h2pl\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.290009 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.289989 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dfdf02c-b11f-4bb0-95a3-e88699da8852-signing-cabundle\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.291970 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.291949 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dfdf02c-b11f-4bb0-95a3-e88699da8852-signing-key\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.298313 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.298287 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h2pl\" (UniqueName: \"kubernetes.io/projected/6dfdf02c-b11f-4bb0-95a3-e88699da8852-kube-api-access-9h2pl\") pod \"service-ca-568869fdc5-s8snw\" (UID: \"6dfdf02c-b11f-4bb0-95a3-e88699da8852\") " pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.436752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.436666 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-s8snw" Sep 16 21:53:20.603197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.603170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hd65k_7d17bf83-68f1-4996-acf8-cf9cc688ac9b/dns-node-resolver/0.log" Sep 16 21:53:20.704146 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.703996 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-s8snw"] Sep 16 21:53:20.706522 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:20.706499 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfdf02c_b11f_4bb0_95a3_e88699da8852.slice/crio-0617dd11fe03cc8ddfbe4d6d710508d21a4ca084a205b669b2752863337f2dfd WatchSource:0}: Error finding container 0617dd11fe03cc8ddfbe4d6d710508d21a4ca084a205b669b2752863337f2dfd: Status 404 returned error can't find the container with id 0617dd11fe03cc8ddfbe4d6d710508d21a4ca084a205b669b2752863337f2dfd Sep 16 21:53:20.795248 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.795211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:20.795405 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:20.795297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:20.795405 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:20.795371 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:20.795405 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:20.795402 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 21:53:20.795530 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:20.795415 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc98bc58f-s6q9m: secret "image-registry-tls" not found Sep 16 21:53:20.795530 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:20.795438 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls podName:24732cb0-e397-49b0-80bd-ff99e0b6164b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:28.795420781 +0000 UTC m=+257.412783618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5srws" (UID: "24732cb0-e397-49b0-80bd-ff99e0b6164b") : secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:20.795530 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:20.795459 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls podName:8f5d3c5d-e8e5-43bc-99e6-850081f30628 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:28.795446026 +0000 UTC m=+257.412808889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls") pod "image-registry-7dc98bc58f-s6q9m" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628") : secret "image-registry-tls" not found Sep 16 21:53:21.096857 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:21.096740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:21.683527 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:21.683497 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-s8snw" event={"ID":"6dfdf02c-b11f-4bb0-95a3-e88699da8852","Type":"ContainerStarted","Data":"80048ce1971bc2930255c5bc8a1a35305d970d1e4bc5eb40f1beb87d6971dbd1"} Sep 16 21:53:21.683705 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:21.683547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-s8snw" event={"ID":"6dfdf02c-b11f-4bb0-95a3-e88699da8852","Type":"ContainerStarted","Data":"0617dd11fe03cc8ddfbe4d6d710508d21a4ca084a205b669b2752863337f2dfd"} Sep 16 21:53:21.701052 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:21.701017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:21.701207 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:21.701091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:21.701207 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:21.701117 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 21:53:21.701207 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:21.701174 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:25.701156352 +0000 UTC m=+254.318519212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : configmap "kube-rbac-proxy" not found Sep 16 21:53:21.701345 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:21.701228 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 21:53:21.701345 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:21.701276 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:25.701253213 +0000 UTC m=+254.318616064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : secret "insights-runtime-extractor-tls" not found Sep 16 21:53:21.702505 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:21.702469 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-s8snw" podStartSLOduration=1.7024546539999998 podStartE2EDuration="1.702454654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:21.701178927 +0000 UTC m=+250.318541790" watchObservedRunningTime="2026-09-16 21:53:21.702454654 +0000 UTC m=+250.319817542" Sep 16 21:53:22.003314 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:22.003230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ngkgc_80ba37ea-2c67-4471-8c7e-47cbda4e4753/node-ca/0.log" Sep 16 21:53:22.722382 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:22.722333 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:22.803351 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:22.803312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mktwb_01a1f86b-e86c-4c85-af68-e9b2327015b2/serve-healthcheck-canary/0.log" Sep 16 21:53:22.910857 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:22.910825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:23.019633 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:23.019548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:23.074921 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:23.074886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:23.185989 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:23.185955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:23.405822 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:23.405789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-tv52t_461bd19e-9421-4cb1-9b1e-7c26bc656388/kube-storage-version-migrator-operator/0.log" Sep 16 21:53:23.412468 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:23.412437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:23.615672 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:23.615634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:53:23.615815 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:23.615786 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 21:53:23.615877 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:23.615866 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs podName:72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e nodeName:}" failed. No retries permitted until 2026-09-16 21:55:25.615850012 +0000 UTC m=+374.233212849 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs") pod "network-metrics-daemon-wvmvr" (UID: "72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e") : secret "metrics-daemon-secret" not found Sep 16 21:53:24.051252 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:24.051210 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:24.419299 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:24.419251 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:24.614223 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:24.614190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:25.017427 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:25.017383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:25.210496 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:25.210460 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:25.734195 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:25.734163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:25.734195 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:25.734196 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:25.734399 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:25.734287 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 21:53:25.734399 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:25.734326 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 21:53:25.734399 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:25.734356 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:33.734341582 +0000 UTC m=+262.351704419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : configmap "kube-rbac-proxy" not found Sep 16 21:53:25.734502 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:25.734415 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls podName:848730f9-aef7-4f05-8e71-cea08eff0779 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:33.73439814 +0000 UTC m=+262.351760978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzqvm" (UID: "848730f9-aef7-4f05-8e71-cea08eff0779") : secret "insights-runtime-extractor-tls" not found Sep 16 21:53:25.811311 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:25.811272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:26.213413 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:26.213378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:26.418264 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:26.418234 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:26.617462 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:26.617418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:26.716944 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:26.716910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:27.006347 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:27.006242 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:27.397457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:27.397417 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:27.621952 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:27.621923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:28.013315 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.013279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:28.211078 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.211026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:28.410966 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.410935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:28.610828 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.610798 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:28.860787 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.860753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:28.860945 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.860814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:28.860985 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:28.860942 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:28.861019 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:28.860997 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls podName:24732cb0-e397-49b0-80bd-ff99e0b6164b nodeName:}" failed. No retries permitted until 2026-09-16 21:53:44.860983713 +0000 UTC m=+273.478346551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5srws" (UID: "24732cb0-e397-49b0-80bd-ff99e0b6164b") : secret "cluster-monitoring-operator-tls" not found Sep 16 21:53:28.863231 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.863204 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"image-registry-7dc98bc58f-s6q9m\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:28.941552 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:28.941523 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:29.201267 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.201186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:29.213762 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.213736 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc98bc58f-s6q9m"] Sep 16 21:53:29.216698 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:29.216676 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5d3c5d_e8e5_43bc_99e6_850081f30628.slice/crio-27f5beb6534b49d806efbcb01630464700fd5ba763e6bcfc70654291febc3b8c WatchSource:0}: Error finding container 27f5beb6534b49d806efbcb01630464700fd5ba763e6bcfc70654291febc3b8c: Status 404 returned error can't find the container with id 27f5beb6534b49d806efbcb01630464700fd5ba763e6bcfc70654291febc3b8c Sep 16 21:53:29.611081 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.611032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:29.710002 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.709963 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" event={"ID":"8f5d3c5d-e8e5-43bc-99e6-850081f30628","Type":"ContainerStarted","Data":"c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5"} Sep 16 21:53:29.710184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.710025 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" event={"ID":"8f5d3c5d-e8e5-43bc-99e6-850081f30628","Type":"ContainerStarted","Data":"27f5beb6534b49d806efbcb01630464700fd5ba763e6bcfc70654291febc3b8c"} Sep 16 21:53:29.710184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.710089 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:53:29.733676 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:29.733629 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" podStartSLOduration=16.733615216 podStartE2EDuration="16.733615216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:29.731768416 +0000 UTC m=+258.349131275" watchObservedRunningTime="2026-09-16 21:53:29.733615216 +0000 UTC m=+258.350978074" Sep 16 21:53:30.007931 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:30.007846 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:30.209541 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:30.209509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:30.409681 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:30.409642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:30.815107 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:30.815007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:30.926526 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:30.926487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:31.667747 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:31.667709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:31.810344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:31.810308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:32.011895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:32.011818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:32.416777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:32.416743 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:33.010872 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.010843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:33.211890 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.211853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:33.410323 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.410290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:33.802342 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.802256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:33.802342 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.802293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:33.802819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.802798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/848730f9-aef7-4f05-8e71-cea08eff0779-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:33.809132 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.809110 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/848730f9-aef7-4f05-8e71-cea08eff0779-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzqvm\" (UID: \"848730f9-aef7-4f05-8e71-cea08eff0779\") " pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:33.934531 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:33.934496 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzqvm" Sep 16 21:53:34.169294 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:34.169258 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:34.201568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:34.201547 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzqvm"] Sep 16 21:53:34.204188 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:34.204153 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848730f9_aef7_4f05_8e71_cea08eff0779.slice/crio-a1d49246b01db5cd15993556e1395b5276ab97133b607090b5e0f79a05e417d0 WatchSource:0}: Error finding container a1d49246b01db5cd15993556e1395b5276ab97133b607090b5e0f79a05e417d0: Status 404 returned error can't find the container with id a1d49246b01db5cd15993556e1395b5276ab97133b607090b5e0f79a05e417d0 Sep 16 21:53:34.271845 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:34.271820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:34.725586 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:34.725555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzqvm" event={"ID":"848730f9-aef7-4f05-8e71-cea08eff0779","Type":"ContainerStarted","Data":"8240a32d6c4dc55c6ebf396d7d268fd098db7ce201bd01e693b6277f96be7a65"} Sep 16 21:53:34.725730 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:34.725606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzqvm" event={"ID":"848730f9-aef7-4f05-8e71-cea08eff0779","Type":"ContainerStarted","Data":"a1d49246b01db5cd15993556e1395b5276ab97133b607090b5e0f79a05e417d0"} Sep 16 21:53:35.731373 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:35.731331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzqvm" event={"ID":"848730f9-aef7-4f05-8e71-cea08eff0779","Type":"ContainerStarted","Data":"433549918daeefaf498a2cddd9c38bc991cf37f7deee90d18d56645f799dac76"} Sep 16 21:53:36.736739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:36.736658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzqvm" event={"ID":"848730f9-aef7-4f05-8e71-cea08eff0779","Type":"ContainerStarted","Data":"8eb1e788fe9c2ef8c690b5799971091c3d10597a12bb31179632c10639456819"} Sep 16 21:53:36.754079 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:36.754022 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hzqvm" podStartSLOduration=16.637558243 podStartE2EDuration="18.754008167s" totalImagesPullingTime="2.116449924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:53:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:36.7536495 +0000 UTC m=+265.371012359" watchObservedRunningTime="2026-09-16 21:53:36.754008167 +0000 UTC m=+265.371371026" Sep 16 21:53:40.792005 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.791971 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc98bc58f-s6q9m"] Sep 16 21:53:40.830591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.830557 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7768cdff84-gxct5"] Sep 16 21:53:40.833356 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.833331 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.854243 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.854217 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7768cdff84-gxct5"] Sep 16 21:53:40.942504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.942471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:40.954729 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-trusted-ca\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.954878 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-installation-pull-secrets\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.954878 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-ca-trust-extracted\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.954878 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-registry-tls\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.954878 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-bound-sa-token\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.955007 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhw5q\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-kube-api-access-dhw5q\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.955007 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.954936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-image-registry-private-configuration\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:40.955086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:40.955015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-registry-certificates\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.040319 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.040281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:41.055850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhw5q\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-kube-api-access-dhw5q\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.055850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-image-registry-private-configuration\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-registry-certificates\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055887 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-trusted-ca\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-installation-pull-secrets\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-ca-trust-extracted\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-registry-tls\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.055982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-bound-sa-token\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.056568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.056539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-ca-trust-extracted\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.057098 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.057048 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-registry-certificates\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.057399 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.057375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-trusted-ca\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.058580 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.058551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-installation-pull-secrets\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.058802 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.058781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-image-registry-private-configuration\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.058860 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.058781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-registry-tls\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.066146 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.066121 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-bound-sa-token\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.066419 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.066400 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhw5q\" (UniqueName: \"kubernetes.io/projected/ab016d94-ddd9-4c51-a920-6ea4ea6a1624-kube-api-access-dhw5q\") pod \"image-registry-7768cdff84-gxct5\" (UID: \"ab016d94-ddd9-4c51-a920-6ea4ea6a1624\") " pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.141870 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.141837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.413086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.413047 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7768cdff84-gxct5"] Sep 16 21:53:41.414966 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:41.414941 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab016d94_ddd9_4c51_a920_6ea4ea6a1624.slice/crio-ad5f5359ee314abc7781e7980fe76594c6bb20a73ad924790748de29a77f3087 WatchSource:0}: Error finding container ad5f5359ee314abc7781e7980fe76594c6bb20a73ad924790748de29a77f3087: Status 404 returned error can't find the container with id ad5f5359ee314abc7781e7980fe76594c6bb20a73ad924790748de29a77f3087 Sep 16 21:53:41.756229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.756155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" event={"ID":"ab016d94-ddd9-4c51-a920-6ea4ea6a1624","Type":"ContainerStarted","Data":"f2949b7347f630024e5485ba1650d0a67b511fbb7459b5bc6b172df3e5eee9f4"} Sep 16 21:53:41.756229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.756201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" event={"ID":"ab016d94-ddd9-4c51-a920-6ea4ea6a1624","Type":"ContainerStarted","Data":"ad5f5359ee314abc7781e7980fe76594c6bb20a73ad924790748de29a77f3087"} Sep 16 21:53:41.756400 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.756293 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:53:41.775576 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:41.775528 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" podStartSLOduration=1.7755125920000001 podStartE2EDuration="1.775512592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:41.77439747 +0000 UTC m=+270.391760326" watchObservedRunningTime="2026-09-16 21:53:41.775512592 +0000 UTC m=+270.392875433" Sep 16 21:53:44.886769 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:44.886723 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:44.889240 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:44.889220 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/24732cb0-e397-49b0-80bd-ff99e0b6164b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5srws\" (UID: \"24732cb0-e397-49b0-80bd-ff99e0b6164b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:45.137452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:45.137361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" Sep 16 21:53:45.406338 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:45.406135 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws"] Sep 16 21:53:45.408607 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:45.408580 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24732cb0_e397_49b0_80bd_ff99e0b6164b.slice/crio-3ea172da11d73a5d76c32f3020ceea0f1371ef75eb72fd29ec6bb4dad3efaa88 WatchSource:0}: Error finding container 3ea172da11d73a5d76c32f3020ceea0f1371ef75eb72fd29ec6bb4dad3efaa88: Status 404 returned error can't find the container with id 3ea172da11d73a5d76c32f3020ceea0f1371ef75eb72fd29ec6bb4dad3efaa88 Sep 16 21:53:45.771764 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:45.771676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" event={"ID":"24732cb0-e397-49b0-80bd-ff99e0b6164b","Type":"ContainerStarted","Data":"3ea172da11d73a5d76c32f3020ceea0f1371ef75eb72fd29ec6bb4dad3efaa88"} Sep 16 21:53:47.265790 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:47.265705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:47.783222 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:47.783182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" event={"ID":"24732cb0-e397-49b0-80bd-ff99e0b6164b","Type":"ContainerStarted","Data":"047ee568bfd10b8dd47cb5b43341362a57f05790e1b1770c561c7856245a78af"} Sep 16 21:53:47.804831 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:47.804781 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5srws" podStartSLOduration=33.268907295 podStartE2EDuration="34.80476586s" totalImagesPullingTime="1.535858565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:47.803979896 +0000 UTC m=+276.421342811" watchObservedRunningTime="2026-09-16 21:53:47.80476586 +0000 UTC m=+276.422128718" Sep 16 21:53:48.590249 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:48.590219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:50.796962 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:50.796929 2575 patch_prober.go:28] interesting pod/image-registry-7dc98bc58f-s6q9m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 16 21:53:50.797334 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:50.796983 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 21:53:51.451182 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:51.451154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:51.513602 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:51.513568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:51.571511 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:51.571481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:52.447879 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:52.447836 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q7g62" podUID="2913d3f1-05b2-4968-b68f-93d666b2ed82" Sep 16 21:53:52.799501 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:52.799424 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q7g62" Sep 16 21:53:53.934258 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:53.934221 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:55.591200 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.591160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:55.669290 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.669257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:53:55.671819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.671793 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2913d3f1-05b2-4968-b68f-93d666b2ed82-metrics-tls\") pod \"dns-default-q7g62\" (UID: \"2913d3f1-05b2-4968-b68f-93d666b2ed82\") " pod="openshift-dns/dns-default-q7g62" Sep 16 21:53:55.802128 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.802102 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pj46n\"" Sep 16 21:53:55.810337 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.810305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q7g62" Sep 16 21:53:55.821682 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.821659 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c"] Sep 16 21:53:55.824370 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.824339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:55.825123 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.824426 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.827492 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.826985 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 16 21:53:55.827492 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.827189 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 21:53:55.827492 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.827317 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 16 21:53:55.828204 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.828145 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dr5cm\"" Sep 16 21:53:55.833536 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.833482 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c"] Sep 16 21:53:55.855506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.855473 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75"] Sep 16 21:53:55.858337 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.858318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.862864 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.862835 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 16 21:53:55.862989 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.862935 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 16 21:53:55.863356 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.863170 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 16 21:53:55.863356 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.863178 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xplqx\"" Sep 16 21:53:55.866900 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.866877 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c85gk"] Sep 16 21:53:55.869822 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.869805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.870980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-sys\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-tls\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-wtmp\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-accelerators-collector-config\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8422\" (UniqueName: \"kubernetes.io/projected/17e5a00d-eff9-43e0-8964-5ba04754f5fc-kube-api-access-f8422\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e5a00d-eff9-43e0-8964-5ba04754f5fc-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-textfile\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871456 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.873305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw95f\" (UniqueName: \"kubernetes.io/projected/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-kube-api-access-cw95f\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-root\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hhd\" (UniqueName: \"kubernetes.io/projected/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-api-access-78hhd\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.871625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-metrics-client-ca\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.872138 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.872462 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.872727 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.872923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lrmkc\"" Sep 16 21:53:55.874138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.873492 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75"] Sep 16 21:53:55.924948 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.924864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:55.974379 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.974348 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8422\" (UniqueName: \"kubernetes.io/projected/17e5a00d-eff9-43e0-8964-5ba04754f5fc-kube-api-access-f8422\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.974548 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.974467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e5a00d-eff9-43e0-8964-5ba04754f5fc-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.974679 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.974660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.974790 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.974774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-textfile\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.974892 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.974876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.974996 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.974982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.975119 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw95f\" (UniqueName: \"kubernetes.io/projected/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-kube-api-access-cw95f\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975254 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.975355 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-root\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975482 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78hhd\" (UniqueName: \"kubernetes.io/projected/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-api-access-78hhd\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.975579 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.975661 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-metrics-client-ca\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975764 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-root\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975828 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975828 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-sys\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975930 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-tls\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975930 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-textfile\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975930 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e5a00d-eff9-43e0-8964-5ba04754f5fc-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.975930 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-wtmp\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.975930 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-accelerators-collector-config\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.976197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.976197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975970 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-wtmp\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.976197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.976197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.976006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-sys\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.976197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.976019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.976440 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.975402 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.976674 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.976653 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.976748 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.976729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-accelerators-collector-config\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.977108 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.977086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-metrics-client-ca\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.977167 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:55.975699 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 16 21:53:55.977217 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:55.977191 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-tls podName:17e5a00d-eff9-43e0-8964-5ba04754f5fc nodeName:}" failed. No retries permitted until 2026-09-16 21:53:56.477171832 +0000 UTC m=+285.094534677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-p6t9c" (UID: "17e5a00d-eff9-43e0-8964-5ba04754f5fc") : secret "openshift-state-metrics-tls" not found Sep 16 21:53:55.977377 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:55.976089 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 16 21:53:55.977450 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:55.977407 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-tls podName:d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c nodeName:}" failed. No retries permitted until 2026-09-16 21:53:56.477393434 +0000 UTC m=+285.094756276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-tls") pod "node-exporter-c85gk" (UID: "d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c") : secret "node-exporter-tls" not found Sep 16 21:53:55.977450 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:55.976803 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 16 21:53:55.977450 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:55.977446 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls podName:5abcdbce-fb2f-4547-bb9d-9bfb555613d0 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:56.477437469 +0000 UTC m=+285.094800308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-9kp75" (UID: "5abcdbce-fb2f-4547-bb9d-9bfb555613d0") : secret "kube-state-metrics-tls" not found Sep 16 21:53:55.979909 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.979856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:55.980140 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.980118 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.980206 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.980184 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.992856 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.992811 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8422\" (UniqueName: \"kubernetes.io/projected/17e5a00d-eff9-43e0-8964-5ba04754f5fc-kube-api-access-f8422\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:55.992964 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.992931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw95f\" (UniqueName: \"kubernetes.io/projected/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-kube-api-access-cw95f\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:55.994368 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:55.994326 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hhd\" (UniqueName: \"kubernetes.io/projected/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-api-access-78hhd\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:56.014110 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.014079 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.106326 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.106242 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q7g62"] Sep 16 21:53:56.109205 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.109175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.110047 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:56.110013 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2913d3f1_05b2_4968_b68f_93d666b2ed82.slice/crio-283a70067c074d3b748e606f2f791c21885ae00530af237d991207120225d105 WatchSource:0}: Error finding container 283a70067c074d3b748e606f2f791c21885ae00530af237d991207120225d105: Status 404 returned error can't find the container with id 283a70067c074d3b748e606f2f791c21885ae00530af237d991207120225d105 Sep 16 21:53:56.163813 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.163762 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.349136 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.349105 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.450533 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.450452 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.479683 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.479652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:56.479861 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.479698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:56.479861 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.479731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-tls\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:56.479861 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:56.479831 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 16 21:53:56.480022 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:53:56.479908 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls podName:5abcdbce-fb2f-4547-bb9d-9bfb555613d0 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:57.479888358 +0000 UTC m=+286.097251195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-9kp75" (UID: "5abcdbce-fb2f-4547-bb9d-9bfb555613d0") : secret "kube-state-metrics-tls" not found Sep 16 21:53:56.482274 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.482242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c-node-exporter-tls\") pod \"node-exporter-c85gk\" (UID: \"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c\") " pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:56.482380 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.482299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5a00d-eff9-43e0-8964-5ba04754f5fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-p6t9c\" (UID: \"17e5a00d-eff9-43e0-8964-5ba04754f5fc\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:56.520018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.519991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c85gk" Sep 16 21:53:56.532161 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:56.532135 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25d3c6b_2ec3_4b36_b533_8b9d4f7ee95c.slice/crio-5be688db2a8208948d0b5cadd8a34dafe5382dd481fc5198a6108ccc65953a6d WatchSource:0}: Error finding container 5be688db2a8208948d0b5cadd8a34dafe5382dd481fc5198a6108ccc65953a6d: Status 404 returned error can't find the container with id 5be688db2a8208948d0b5cadd8a34dafe5382dd481fc5198a6108ccc65953a6d Sep 16 21:53:56.572306 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.572270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.743482 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.743399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" Sep 16 21:53:56.818167 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.818099 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85gk" event={"ID":"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c","Type":"ContainerStarted","Data":"5be688db2a8208948d0b5cadd8a34dafe5382dd481fc5198a6108ccc65953a6d"} Sep 16 21:53:56.820155 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.820052 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q7g62" event={"ID":"2913d3f1-05b2-4968-b68f-93d666b2ed82","Type":"ContainerStarted","Data":"283a70067c074d3b748e606f2f791c21885ae00530af237d991207120225d105"} Sep 16 21:53:56.825435 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.825380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:56.905679 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:56.905596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:57.042716 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.042638 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c"] Sep 16 21:53:57.045656 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:57.045623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e5a00d_eff9_43e0_8964_5ba04754f5fc.slice/crio-d8d0f7c72d9debe63c906db2d9bde9fbd51a612b60f498e5e111c65eb75580f0 WatchSource:0}: Error finding container d8d0f7c72d9debe63c906db2d9bde9fbd51a612b60f498e5e111c65eb75580f0: Status 404 returned error can't find the container with id d8d0f7c72d9debe63c906db2d9bde9fbd51a612b60f498e5e111c65eb75580f0 Sep 16 21:53:57.225708 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.225626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:57.424851 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.424817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:57.486933 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.486892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:57.489714 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.489691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5abcdbce-fb2f-4547-bb9d-9bfb555613d0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-9kp75\" (UID: \"5abcdbce-fb2f-4547-bb9d-9bfb555613d0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:57.677896 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.677818 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" Sep 16 21:53:57.825641 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.825603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" event={"ID":"17e5a00d-eff9-43e0-8964-5ba04754f5fc","Type":"ContainerStarted","Data":"66c1cfc25ca7515ce487c55592d7c65b2dfd900ed866f8a45a09ddd2c1a66f35"} Sep 16 21:53:57.826018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.825674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" event={"ID":"17e5a00d-eff9-43e0-8964-5ba04754f5fc","Type":"ContainerStarted","Data":"cbe088123a5a4813e85e4ad3b4c1b78e3e4b9b897e37933293e2255f9fc3b34b"} Sep 16 21:53:57.826018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:57.825704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" event={"ID":"17e5a00d-eff9-43e0-8964-5ba04754f5fc","Type":"ContainerStarted","Data":"d8d0f7c72d9debe63c906db2d9bde9fbd51a612b60f498e5e111c65eb75580f0"} Sep 16 21:53:58.304752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.304414 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75"] Sep 16 21:53:58.306812 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:53:58.306781 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abcdbce_fb2f_4547_bb9d_9bfb555613d0.slice/crio-c36e0a577862c9770f46a9fca0d55d3094e70984050c76b51ec4e3c362c55e85 WatchSource:0}: Error finding container c36e0a577862c9770f46a9fca0d55d3094e70984050c76b51ec4e3c362c55e85: Status 404 returned error can't find the container with id c36e0a577862c9770f46a9fca0d55d3094e70984050c76b51ec4e3c362c55e85 Sep 16 21:53:58.755870 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.755830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:58.831710 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.831670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" event={"ID":"17e5a00d-eff9-43e0-8964-5ba04754f5fc","Type":"ContainerStarted","Data":"d0dc5a2df2d35089fdf057ba7e8bde33975238076c311f3c465558fc828ccd15"} Sep 16 21:53:58.833571 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.833547 2575 generic.go:356] "Generic (PLEG): container finished" podID="d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c" containerID="a61213592390b4dea06820dea2dc47df88f163225eff132ba653d2f1bc6d91ed" exitCode=0 Sep 16 21:53:58.833690 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.833616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85gk" event={"ID":"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c","Type":"ContainerDied","Data":"a61213592390b4dea06820dea2dc47df88f163225eff132ba653d2f1bc6d91ed"} Sep 16 21:53:58.838425 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.838305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q7g62" event={"ID":"2913d3f1-05b2-4968-b68f-93d666b2ed82","Type":"ContainerStarted","Data":"c0c5094aaee9dfbed75eaee147270f7402c8da853ff967754074f981ee6ec64e"} Sep 16 21:53:58.838425 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.838352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q7g62" event={"ID":"2913d3f1-05b2-4968-b68f-93d666b2ed82","Type":"ContainerStarted","Data":"fa02453b448d611bb112f063065fca2698bab56fc74e4318d046f8d0df372e7a"} Sep 16 21:53:58.838425 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.838393 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q7g62" Sep 16 21:53:58.840259 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.840243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" event={"ID":"5abcdbce-fb2f-4547-bb9d-9bfb555613d0","Type":"ContainerStarted","Data":"c36e0a577862c9770f46a9fca0d55d3094e70984050c76b51ec4e3c362c55e85"} Sep 16 21:53:58.847491 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.847405 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-p6t9c" podStartSLOduration=2.401852022 podStartE2EDuration="3.84738882s" totalImagesPullingTime="1.445536798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:58.846774904 +0000 UTC m=+287.464137764" watchObservedRunningTime="2026-09-16 21:53:58.84738882 +0000 UTC m=+287.464751677" Sep 16 21:53:58.854412 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.854389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:58.863367 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.863329 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q7g62" podStartSLOduration=251.949817598 podStartE2EDuration="4m13.863317801s" totalImagesPullingTime="1.913500203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:58.862123973 +0000 UTC m=+287.479486832" watchObservedRunningTime="2026-09-16 21:53:58.863317801 +0000 UTC m=+287.480680661" Sep 16 21:53:58.979268 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:58.979242 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:59.232902 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.232821 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:53:59.831916 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.831055 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj"] Sep 16 21:53:59.836320 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.836294 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839086 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839255 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839254 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839338 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2qvrp\"" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839429 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839446 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 16 21:53:59.839547 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.839344 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5pcep0vgf8sn6\"" Sep 16 21:53:59.848694 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.848552 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj"] Sep 16 21:53:59.851266 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.851226 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85gk" event={"ID":"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c","Type":"ContainerStarted","Data":"05861b32068ad6f619d89e095af4755167ec985cf6939c9cbb49ef2a478e2c2b"} Sep 16 21:53:59.851266 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.851277 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85gk" event={"ID":"d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c","Type":"ContainerStarted","Data":"9c42f276dadc1a881ee5e7016af9244aae79a78e00ac17e0a3e67da1002b1a76"} Sep 16 21:53:59.854866 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.854224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" event={"ID":"5abcdbce-fb2f-4547-bb9d-9bfb555613d0","Type":"ContainerStarted","Data":"8082008c0cb91ff7ec5045ae814bb620aee9668c096dccd8bdb1ecf5d796b5d9"} Sep 16 21:53:59.854866 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.854273 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" event={"ID":"5abcdbce-fb2f-4547-bb9d-9bfb555613d0","Type":"ContainerStarted","Data":"2bcc9e45b1b042301db0dfc869cf46a61f19369781f109c7b02f1c22338ba81d"} Sep 16 21:53:59.891493 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.891450 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c85gk" podStartSLOduration=3.302536622 podStartE2EDuration="4.89143121s" totalImagesPullingTime="1.491503898s" totalInitContainerRuntime="97.39069ms" isStatefulPod=true podCreationTimestamp="2026-09-16 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:59.891280484 +0000 UTC m=+288.508643343" watchObservedRunningTime="2026-09-16 21:53:59.89143121 +0000 UTC m=+288.508794072" Sep 16 21:53:59.906820 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.906792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.906925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.906996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb798833-e71d-4a37-8df4-f6cd83c1a081-metrics-client-ca\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.907039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-grpc-tls\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907475 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.907250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj8jw\" (UniqueName: \"kubernetes.io/projected/eb798833-e71d-4a37-8df4-f6cd83c1a081-kube-api-access-wj8jw\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907475 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.907304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-tls\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907639 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.907485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:53:59.907639 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:53:59.907547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.008682 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8jw\" (UniqueName: \"kubernetes.io/projected/eb798833-e71d-4a37-8df4-f6cd83c1a081-kube-api-access-wj8jw\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.008682 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-tls\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.008881 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.008881 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.008881 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.009018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.009018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb798833-e71d-4a37-8df4-f6cd83c1a081-metrics-client-ca\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.009018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.008999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-grpc-tls\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.009838 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.009784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb798833-e71d-4a37-8df4-f6cd83c1a081-metrics-client-ca\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.011778 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.011722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.012125 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.012099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.012282 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.012257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-tls\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.012350 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.012279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.012433 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.012402 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.012816 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.012797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb798833-e71d-4a37-8df4-f6cd83c1a081-secret-grpc-tls\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.019420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.019383 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj8jw\" (UniqueName: \"kubernetes.io/projected/eb798833-e71d-4a37-8df4-f6cd83c1a081-kube-api-access-wj8jw\") pod \"thanos-querier-7ff87b7ff6-q7ksj\" (UID: \"eb798833-e71d-4a37-8df4-f6cd83c1a081\") " pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.145408 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.145370 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-856bc9bbd7-tbhsq"] Sep 16 21:54:00.149798 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.149773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.152522 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.152481 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 16 21:54:00.152660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.152526 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 21:54:00.152660 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.152634 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8tzjf\"" Sep 16 21:54:00.152771 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.152758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 16 21:54:00.152850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.152835 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5r6t9nt55qh8c\"" Sep 16 21:54:00.152964 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.152949 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 16 21:54:00.158800 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.158777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-856bc9bbd7-tbhsq"] Sep 16 21:54:00.169123 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.169105 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:00.210976 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.210943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-client-ca-bundle\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.211184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.210984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/22d542c9-204a-4b7b-bb2f-6adf216ef50f-audit-log\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.211184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.211038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-secret-metrics-server-client-certs\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.211184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.211054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-secret-metrics-server-tls\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.211184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.211119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d542c9-204a-4b7b-bb2f-6adf216ef50f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.211184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.211141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/22d542c9-204a-4b7b-bb2f-6adf216ef50f-metrics-server-audit-profiles\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.211184 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.211158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4v47\" (UniqueName: \"kubernetes.io/projected/22d542c9-204a-4b7b-bb2f-6adf216ef50f-kube-api-access-n4v47\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.311791 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.311709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-client-ca-bundle\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.311791 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.311754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/22d542c9-204a-4b7b-bb2f-6adf216ef50f-audit-log\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.311958 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.311809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-secret-metrics-server-client-certs\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.311958 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.311827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-secret-metrics-server-tls\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.311958 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.311850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d542c9-204a-4b7b-bb2f-6adf216ef50f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.312130 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.311995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/22d542c9-204a-4b7b-bb2f-6adf216ef50f-metrics-server-audit-profiles\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.312130 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.312029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4v47\" (UniqueName: \"kubernetes.io/projected/22d542c9-204a-4b7b-bb2f-6adf216ef50f-kube-api-access-n4v47\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.312382 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.312358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/22d542c9-204a-4b7b-bb2f-6adf216ef50f-audit-log\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.312707 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.312663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22d542c9-204a-4b7b-bb2f-6adf216ef50f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.313278 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.313252 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/22d542c9-204a-4b7b-bb2f-6adf216ef50f-metrics-server-audit-profiles\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.314349 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.314325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-client-ca-bundle\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.314488 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.314472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-secret-metrics-server-client-certs\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.314535 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.314517 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/22d542c9-204a-4b7b-bb2f-6adf216ef50f-secret-metrics-server-tls\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.319402 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.319386 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4v47\" (UniqueName: \"kubernetes.io/projected/22d542c9-204a-4b7b-bb2f-6adf216ef50f-kube-api-access-n4v47\") pod \"metrics-server-856bc9bbd7-tbhsq\" (UID: \"22d542c9-204a-4b7b-bb2f-6adf216ef50f\") " pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.440296 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.440260 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj"] Sep 16 21:54:00.443169 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:54:00.443135 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb798833_e71d_4a37_8df4_f6cd83c1a081.slice/crio-bcb1db3dbc4b1414b04ac5dc7900a98a53dc86e6db4462a7b5de1b3b22f8e121 WatchSource:0}: Error finding container bcb1db3dbc4b1414b04ac5dc7900a98a53dc86e6db4462a7b5de1b3b22f8e121: Status 404 returned error can't find the container with id bcb1db3dbc4b1414b04ac5dc7900a98a53dc86e6db4462a7b5de1b3b22f8e121 Sep 16 21:54:00.460032 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.460012 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:00.611895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.611841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:00.730705 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.730312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-856bc9bbd7-tbhsq"] Sep 16 21:54:00.733213 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:54:00.733187 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d542c9_204a_4b7b_bb2f_6adf216ef50f.slice/crio-154f8da0107655745b5e87d440016c89c04c17a389b4ca17ce61e3dcefaf06fa WatchSource:0}: Error finding container 154f8da0107655745b5e87d440016c89c04c17a389b4ca17ce61e3dcefaf06fa: Status 404 returned error can't find the container with id 154f8da0107655745b5e87d440016c89c04c17a389b4ca17ce61e3dcefaf06fa Sep 16 21:54:00.796182 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.796144 2575 patch_prober.go:28] interesting pod/image-registry-7dc98bc58f-s6q9m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 16 21:54:00.796316 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.796203 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 21:54:00.861199 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.861165 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" event={"ID":"5abcdbce-fb2f-4547-bb9d-9bfb555613d0","Type":"ContainerStarted","Data":"d495b535802f8c0ab036b6854cc57a93de01eae7378e76fa82185d6535965692"} Sep 16 21:54:00.862450 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.862397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"bcb1db3dbc4b1414b04ac5dc7900a98a53dc86e6db4462a7b5de1b3b22f8e121"} Sep 16 21:54:00.863535 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.863511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" event={"ID":"22d542c9-204a-4b7b-bb2f-6adf216ef50f","Type":"ContainerStarted","Data":"154f8da0107655745b5e87d440016c89c04c17a389b4ca17ce61e3dcefaf06fa"} Sep 16 21:54:00.878628 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:00.878591 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-9kp75" podStartSLOduration=4.498687629 podStartE2EDuration="5.878578068s" totalImagesPullingTime="1.379890439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:00.87818499 +0000 UTC m=+289.495547869" watchObservedRunningTime="2026-09-16 21:54:00.878578068 +0000 UTC m=+289.495940926" Sep 16 21:54:01.072120 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.072084 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74665797c7-nr2rz"] Sep 16 21:54:01.076764 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.076737 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.079778 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.079752 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-24trp\"" Sep 16 21:54:01.079995 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.079890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 16 21:54:01.079995 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.079929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 16 21:54:01.079995 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.079983 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 16 21:54:01.080232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.080002 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 16 21:54:01.080232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.080227 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 16 21:54:01.084731 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.084539 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 16 21:54:01.088536 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.088507 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74665797c7-nr2rz"] Sep 16 21:54:01.121389 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121389 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-serving-certs-ca-bundle\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-telemeter-client-tls\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5sz\" (UniqueName: \"kubernetes.io/projected/af19e1da-8e03-4650-85c5-0e77c65ed601-kube-api-access-hs5sz\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-federate-client-tls\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-secret-telemeter-client\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.121724 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.121620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-metrics-client-ca\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.146632 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.146603 2575 patch_prober.go:28] interesting pod/image-registry-7768cdff84-gxct5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 16 21:54:01.146778 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.146657 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" podUID="ab016d94-ddd9-4c51-a920-6ea4ea6a1624" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 21:54:01.222506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-federate-client-tls\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222506 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222684 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-secret-telemeter-client\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222684 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-metrics-client-ca\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222684 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222684 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-serving-certs-ca-bundle\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222886 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-telemeter-client-tls\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.222886 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.222728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5sz\" (UniqueName: \"kubernetes.io/projected/af19e1da-8e03-4650-85c5-0e77c65ed601-kube-api-access-hs5sz\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.223880 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.223852 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-metrics-client-ca\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.224025 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.223979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.224258 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.224234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af19e1da-8e03-4650-85c5-0e77c65ed601-serving-certs-ca-bundle\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.225295 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.225277 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-federate-client-tls\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.225394 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.225375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-secret-telemeter-client\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.225464 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.225404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.225519 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.225478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/af19e1da-8e03-4650-85c5-0e77c65ed601-telemeter-client-tls\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.230086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.230045 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5sz\" (UniqueName: \"kubernetes.io/projected/af19e1da-8e03-4650-85c5-0e77c65ed601-kube-api-access-hs5sz\") pod \"telemeter-client-74665797c7-nr2rz\" (UID: \"af19e1da-8e03-4650-85c5-0e77c65ed601\") " pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.257753 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.257730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:01.358491 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.358452 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:01.390453 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.390385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" Sep 16 21:54:01.459089 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.458970 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:01.678696 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.678646 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74665797c7-nr2rz"] Sep 16 21:54:01.681181 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:54:01.681148 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf19e1da_8e03_4650_85c5_0e77c65ed601.slice/crio-aa543a1734aec3d66cb92f90399828453e48d7be7adbaa47beae2904f5dd5b83 WatchSource:0}: Error finding container aa543a1734aec3d66cb92f90399828453e48d7be7adbaa47beae2904f5dd5b83: Status 404 returned error can't find the container with id aa543a1734aec3d66cb92f90399828453e48d7be7adbaa47beae2904f5dd5b83 Sep 16 21:54:01.869150 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:01.869111 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" event={"ID":"af19e1da-8e03-4650-85c5-0e77c65ed601","Type":"ContainerStarted","Data":"aa543a1734aec3d66cb92f90399828453e48d7be7adbaa47beae2904f5dd5b83"} Sep 16 21:54:02.016541 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:02.016429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:02.765927 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:02.765893 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7768cdff84-gxct5" Sep 16 21:54:02.906395 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:02.906356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:03.009795 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.009730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:03.107497 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.107461 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:03.886619 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.886585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"0c6caf4c49277889d6aae0ddc95b1f78bb3f2e093b7d70686d71c18b2db53482"} Sep 16 21:54:03.886717 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.886673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"e97074c1912e2abf6a1b08acc803d4f1e86c561ca1d529273d77648d9eec80be"} Sep 16 21:54:03.886756 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.886720 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"4cf646fafdd1bb1ecc7f372115917d2e1106631fabe7033051aa210a7854686a"} Sep 16 21:54:03.886786 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.886762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"5024bcf07ae7d517295dcfebd8d16b90f764aa590de47bc10f551f01f393be16"} Sep 16 21:54:03.886821 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.886805 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" event={"ID":"22d542c9-204a-4b7b-bb2f-6adf216ef50f","Type":"ContainerStarted","Data":"c25125e159562119509aafac3502c7bb9cf842b8b1b97d2f079cdd9e07756cee"} Sep 16 21:54:03.900152 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:03.900106 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" podStartSLOduration=1.734052266 podStartE2EDuration="3.90009063s" totalImagesPullingTime="2.166038364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:03.898407917 +0000 UTC m=+292.515770775" watchObservedRunningTime="2026-09-16 21:54:03.90009063 +0000 UTC m=+292.517453486" Sep 16 21:54:04.891584 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:04.891554 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"5f1ec0542941446ac712251c2d505fd00662a9080f7d915a2d81f93c70c73619"} Sep 16 21:54:04.891975 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:04.891619 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" event={"ID":"eb798833-e71d-4a37-8df4-f6cd83c1a081","Type":"ContainerStarted","Data":"d0e19e5395e5731697cae9620045c6b4c62215120eff0b21482a94d8c9906c2c"} Sep 16 21:54:04.891975 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:04.891690 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:04.893137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:04.893112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" event={"ID":"af19e1da-8e03-4650-85c5-0e77c65ed601","Type":"ContainerStarted","Data":"f12df07f0d8f28950cb9343647e3f566d094d6cd3dbb79dc9b70e90ae26cdda4"} Sep 16 21:54:04.917953 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:04.917899 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" podStartSLOduration=2.793165422 podStartE2EDuration="5.917877801s" totalImagesPullingTime="3.124712379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:53:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:04.916027861 +0000 UTC m=+293.533390721" watchObservedRunningTime="2026-09-16 21:54:04.917877801 +0000 UTC m=+293.535240665" Sep 16 21:54:05.810833 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:05.810747 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerName="registry" containerID="cri-o://c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5" gracePeriod=30 Sep 16 21:54:05.898242 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:05.898206 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" event={"ID":"af19e1da-8e03-4650-85c5-0e77c65ed601","Type":"ContainerStarted","Data":"32c57d199b581e77bb90c1ce80ff23966b1effd2f093e96311e91525f9970a52"} Sep 16 21:54:05.898626 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:05.898275 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" event={"ID":"af19e1da-8e03-4650-85c5-0e77c65ed601","Type":"ContainerStarted","Data":"368d9de1991ae011c6244e37f1791b65c53a5ce2f00c5f6c2efe7c375484309b"} Sep 16 21:54:06.047897 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.047869 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:54:06.065828 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.065734 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74665797c7-nr2rz" podStartSLOduration=1.394511761 podStartE2EDuration="5.065713571s" totalImagesPullingTime="3.67120181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:05.921704153 +0000 UTC m=+294.539067011" watchObservedRunningTime="2026-09-16 21:54:06.065713571 +0000 UTC m=+294.683076433" Sep 16 21:54:06.175670 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175637 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-certificates\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175695 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175736 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-image-registry-private-configuration\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175763 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcl5q\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-kube-api-access-bcl5q\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175786 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5d3c5d-e8e5-43bc-99e6-850081f30628-ca-trust-extracted\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175998 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175811 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-trusted-ca\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175998 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175843 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-installation-pull-secrets\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.175998 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.175874 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-bound-sa-token\") pod \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\" (UID: \"8f5d3c5d-e8e5-43bc-99e6-850081f30628\") " Sep 16 21:54:06.176277 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.176247 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:54:06.176550 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.176493 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:54:06.178327 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.178297 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 21:54:06.178428 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.178342 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 21:54:06.178573 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.178545 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:54:06.178627 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.178603 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-kube-api-access-bcl5q" (OuterVolumeSpecName: "kube-api-access-bcl5q") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "kube-api-access-bcl5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:54:06.178728 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.178710 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:54:06.184028 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.184007 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f5d3c5d-e8e5-43bc-99e6-850081f30628-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f5d3c5d-e8e5-43bc-99e6-850081f30628" (UID: "8f5d3c5d-e8e5-43bc-99e6-850081f30628"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:54:06.277417 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277384 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-tls\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277417 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277411 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-image-registry-private-configuration\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277417 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277421 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcl5q\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-kube-api-access-bcl5q\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277431 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f5d3c5d-e8e5-43bc-99e6-850081f30628-ca-trust-extracted\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277441 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-trusted-ca\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277449 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f5d3c5d-e8e5-43bc-99e6-850081f30628-installation-pull-secrets\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277457 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f5d3c5d-e8e5-43bc-99e6-850081f30628-bound-sa-token\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.277638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.277464 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f5d3c5d-e8e5-43bc-99e6-850081f30628-registry-certificates\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:54:06.905769 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.905727 2575 generic.go:356] "Generic (PLEG): container finished" podID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerID="c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5" exitCode=0 Sep 16 21:54:06.905769 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.905767 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" Sep 16 21:54:06.906316 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.905818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" event={"ID":"8f5d3c5d-e8e5-43bc-99e6-850081f30628","Type":"ContainerDied","Data":"c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5"} Sep 16 21:54:06.906316 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.905870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc98bc58f-s6q9m" event={"ID":"8f5d3c5d-e8e5-43bc-99e6-850081f30628","Type":"ContainerDied","Data":"27f5beb6534b49d806efbcb01630464700fd5ba763e6bcfc70654291febc3b8c"} Sep 16 21:54:06.906316 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.905890 2575 scope.go:117] "RemoveContainer" containerID="c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5" Sep 16 21:54:06.914975 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.914959 2575 scope.go:117] "RemoveContainer" containerID="c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5" Sep 16 21:54:06.915272 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:54:06.915252 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5\": container with ID starting with c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5 not found: ID does not exist" containerID="c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5" Sep 16 21:54:06.915319 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.915282 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5"} err="failed to get container status \"c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5\": rpc error: code = NotFound desc = could not find container \"c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5\": container with ID starting with c00301b880307c2fc512bdc548f2863df16d48b9c9d207f2d50a9ee68a1c12d5 not found: ID does not exist" Sep 16 21:54:06.928653 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.928628 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc98bc58f-s6q9m"] Sep 16 21:54:06.932590 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:06.932572 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dc98bc58f-s6q9m"] Sep 16 21:54:07.881036 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:54:07.881002 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wvmvr" podUID="72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e" Sep 16 21:54:07.884537 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:07.884512 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" path="/var/lib/kubelet/pods/8f5d3c5d-e8e5-43bc-99e6-850081f30628/volumes" Sep 16 21:54:08.857005 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:08.856976 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q7g62" Sep 16 21:54:09.932419 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:09.932394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:10.240572 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:10.240498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:10.904221 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:10.904196 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7ff87b7ff6-q7ksj" Sep 16 21:54:11.764428 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.764404 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 21:54:11.811732 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.811599 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-5s8n9"] Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.812048 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerName="registry" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.812083 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerName="registry" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.812155 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f5d3c5d-e8e5-43bc-99e6-850081f30628" containerName="registry" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.817900 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.820397 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.820421 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-spmlb\"" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.820421 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.824959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:11.842804 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.825472 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-5s8n9"] Sep 16 21:54:11.923323 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.923288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:11.923481 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:11.923326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985wh\" (UniqueName: \"kubernetes.io/projected/4f226e73-b0be-42dc-819f-000772fdc0bc-kube-api-access-985wh\") pod \"downloads-76f99584f4-5s8n9\" (UID: \"4f226e73-b0be-42dc-819f-000772fdc0bc\") " pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:12.024004 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.023918 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:12.024004 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.023991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985wh\" (UniqueName: \"kubernetes.io/projected/4f226e73-b0be-42dc-819f-000772fdc0bc-kube-api-access-985wh\") pod \"downloads-76f99584f4-5s8n9\" (UID: \"4f226e73-b0be-42dc-819f-000772fdc0bc\") " pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:12.031944 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.031916 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985wh\" (UniqueName: \"kubernetes.io/projected/4f226e73-b0be-42dc-819f-000772fdc0bc-kube-api-access-985wh\") pod \"downloads-76f99584f4-5s8n9\" (UID: \"4f226e73-b0be-42dc-819f-000772fdc0bc\") " pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:12.124354 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.124319 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:12.129228 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.129202 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:12.397896 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.397872 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-5s8n9"] Sep 16 21:54:12.400316 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:54:12.400293 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f226e73_b0be_42dc_819f_000772fdc0bc.slice/crio-b4432a91377932970c77b48a6f553aa89fa5621f914224c3bd82718807a2e490 WatchSource:0}: Error finding container b4432a91377932970c77b48a6f553aa89fa5621f914224c3bd82718807a2e490: Status 404 returned error can't find the container with id b4432a91377932970c77b48a6f553aa89fa5621f914224c3bd82718807a2e490 Sep 16 21:54:12.502425 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.502393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:12.905440 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.905402 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:12.928201 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.928168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-5s8n9" event={"ID":"4f226e73-b0be-42dc-819f-000772fdc0bc","Type":"ContainerStarted","Data":"b4432a91377932970c77b48a6f553aa89fa5621f914224c3bd82718807a2e490"} Sep 16 21:54:12.961420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:12.961392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:13.300009 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:13.299888 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:13.467603 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:13.467554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:13.567844 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:13.567738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:13.703423 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:13.703358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:14.772788 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:14.772724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:14.828154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:14.828115 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:15.116757 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:15.116709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:15.164015 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:15.163952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:16.103856 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:16.103824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:16.160463 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:16.160430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:17.722732 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.722694 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c7cb69bb9-2d5ds"] Sep 16 21:54:17.726532 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.726511 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.729340 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.729311 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 21:54:17.729477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.729345 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 21:54:17.730509 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.730479 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 21:54:17.730509 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.730496 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hq5tz\"" Sep 16 21:54:17.730673 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.730496 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 21:54:17.730673 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.730604 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 21:54:17.735583 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.735218 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7cb69bb9-2d5ds"] Sep 16 21:54:17.873878 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.873843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-oauth-serving-cert\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.874035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.873936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-serving-cert\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.874035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.873959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-config\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.874035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.874015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-oauth-config\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.874035 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.874031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqknf\" (UniqueName: \"kubernetes.io/projected/7be3685c-f18a-4420-bad5-058ae3ba75d0-kube-api-access-kqknf\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.874255 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.874160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-service-ca\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.974916 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.974829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-oauth-serving-cert\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.974916 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.974910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-serving-cert\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.975218 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.974935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-config\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.975218 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.974978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-oauth-config\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.975218 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.975002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqknf\" (UniqueName: \"kubernetes.io/projected/7be3685c-f18a-4420-bad5-058ae3ba75d0-kube-api-access-kqknf\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.975218 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.975092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-service-ca\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.975773 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.975721 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-oauth-serving-cert\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.975773 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.975760 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-service-ca\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.976048 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.976026 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-config\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.978051 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.978029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-oauth-config\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.978538 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.978518 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-serving-cert\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:17.983169 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:17.983146 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqknf\" (UniqueName: \"kubernetes.io/projected/7be3685c-f18a-4420-bad5-058ae3ba75d0-kube-api-access-kqknf\") pod \"console-6c7cb69bb9-2d5ds\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:18.038933 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:18.038896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:18.333962 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:18.333935 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7cb69bb9-2d5ds"] Sep 16 21:54:18.336023 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:54:18.335994 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be3685c_f18a_4420_bad5_058ae3ba75d0.slice/crio-edfe1dfdb85562cad46cd82929f8eaa0b55953bb61b904f4085d05a6d47448c7 WatchSource:0}: Error finding container edfe1dfdb85562cad46cd82929f8eaa0b55953bb61b904f4085d05a6d47448c7: Status 404 returned error can't find the container with id edfe1dfdb85562cad46cd82929f8eaa0b55953bb61b904f4085d05a6d47448c7 Sep 16 21:54:18.338976 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:18.338958 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 21:54:18.950925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:18.950888 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:18.957908 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:18.957867 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7cb69bb9-2d5ds" event={"ID":"7be3685c-f18a-4420-bad5-058ae3ba75d0","Type":"ContainerStarted","Data":"edfe1dfdb85562cad46cd82929f8eaa0b55953bb61b904f4085d05a6d47448c7"} Sep 16 21:54:19.168293 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:19.168252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:19.269046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:19.268969 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:20.460932 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:20.460886 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:20.461450 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:20.460998 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:21.974858 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:21.974812 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7cb69bb9-2d5ds" event={"ID":"7be3685c-f18a-4420-bad5-058ae3ba75d0","Type":"ContainerStarted","Data":"8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8"} Sep 16 21:54:21.994512 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:21.994457 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c7cb69bb9-2d5ds" podStartSLOduration=1.847569617 podStartE2EDuration="4.994436515s" totalImagesPullingTime="3.146866898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:21.993105735 +0000 UTC m=+310.610468596" watchObservedRunningTime="2026-09-16 21:54:21.994436515 +0000 UTC m=+310.611799375" Sep 16 21:54:22.880254 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:22.880212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:54:22.981823 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:22.981787 2575 generic.go:356] "Generic (PLEG): container finished" podID="4b2e3c69-6270-4b1d-901b-5c361018da4a" containerID="1563df51d8cfca491646dc8fc12139572670929f743cf17140e8637701f22ae3" exitCode=0 Sep 16 21:54:22.982236 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:22.981878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" event={"ID":"4b2e3c69-6270-4b1d-901b-5c361018da4a","Type":"ContainerDied","Data":"1563df51d8cfca491646dc8fc12139572670929f743cf17140e8637701f22ae3"} Sep 16 21:54:22.982333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:22.982318 2575 scope.go:117] "RemoveContainer" containerID="1563df51d8cfca491646dc8fc12139572670929f743cf17140e8637701f22ae3" Sep 16 21:54:23.865523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:23.865493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:23.966841 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:23.966804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:25.119727 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:25.119689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:25.172056 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:25.172020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:26.120416 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.120375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:26.175323 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.175283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:26.519044 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.518928 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68549d7778-h66vs"] Sep 16 21:54:26.554121 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.554082 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68549d7778-h66vs"] Sep 16 21:54:26.554279 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.554183 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.562434 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.562412 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 16 21:54:26.657827 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.657786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-oauth-config\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.657827 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.657828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztw9r\" (UniqueName: \"kubernetes.io/projected/e3255045-e221-4dbb-82f2-d5495692e686-kube-api-access-ztw9r\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.658047 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.657889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-console-config\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.658047 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.657923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-service-ca\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.658047 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.657991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-serving-cert\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.658047 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.658019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-oauth-serving-cert\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.658047 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.658041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-trusted-ca-bundle\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759165 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-oauth-serving-cert\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-trusted-ca-bundle\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-oauth-config\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw9r\" (UniqueName: \"kubernetes.io/projected/e3255045-e221-4dbb-82f2-d5495692e686-kube-api-access-ztw9r\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-console-config\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759338 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-service-ca\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.759616 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.759372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-serving-cert\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.760142 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.760102 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-oauth-serving-cert\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.760428 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.760223 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-trusted-ca-bundle\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.760490 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.760456 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-service-ca\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.760648 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.760605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-console-config\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.762805 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.762785 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-oauth-config\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.762901 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.762828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-serving-cert\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.772721 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.772667 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw9r\" (UniqueName: \"kubernetes.io/projected/e3255045-e221-4dbb-82f2-d5495692e686-kube-api-access-ztw9r\") pod \"console-68549d7778-h66vs\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:26.864871 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:26.864837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:28.040045 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:28.040010 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:28.040507 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:28.040101 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:28.045720 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:28.045696 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:29.013091 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:29.013042 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:54:29.730674 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:29.730632 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:30.014864 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.014776 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-5s8n9" event={"ID":"4f226e73-b0be-42dc-819f-000772fdc0bc","Type":"ContainerStarted","Data":"b3078275a2177d4b86433da2a3388d9405591e7b9452fb972e07acc899f7c33d"} Sep 16 21:54:30.015017 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.014928 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:30.016708 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.016684 2575 patch_prober.go:28] interesting pod/downloads-76f99584f4-5s8n9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.21:8080/\": dial tcp 10.134.0.21:8080: connect: connection refused" start-of-body= Sep 16 21:54:30.016840 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.016729 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-5s8n9" podUID="4f226e73-b0be-42dc-819f-000772fdc0bc" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.21:8080/\": dial tcp 10.134.0.21:8080: connect: connection refused" Sep 16 21:54:30.017195 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.017167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-ttnx9" event={"ID":"4b2e3c69-6270-4b1d-901b-5c361018da4a","Type":"ContainerStarted","Data":"e96e395bc7e17a04e9e26f215aa8b79211d4a6fc431e0a39682183df4f25fc20"} Sep 16 21:54:30.032275 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.032222 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-5s8n9" podStartSLOduration=1.555759026 podStartE2EDuration="19.032205912s" totalImagesPullingTime="17.476446886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:30.030559419 +0000 UTC m=+318.647922279" watchObservedRunningTime="2026-09-16 21:54:30.032205912 +0000 UTC m=+318.649568771" Sep 16 21:54:30.072483 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:30.072437 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68549d7778-h66vs"] Sep 16 21:54:30.079987 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:54:30.078891 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3255045_e221_4dbb_82f2_d5495692e686.slice/crio-833c2284948362c63f016ba896548443bbb81be2f74f2e8304bac453ddf20d05 WatchSource:0}: Error finding container 833c2284948362c63f016ba896548443bbb81be2f74f2e8304bac453ddf20d05: Status 404 returned error can't find the container with id 833c2284948362c63f016ba896548443bbb81be2f74f2e8304bac453ddf20d05 Sep 16 21:54:31.024102 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:31.024038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68549d7778-h66vs" event={"ID":"e3255045-e221-4dbb-82f2-d5495692e686","Type":"ContainerStarted","Data":"d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be"} Sep 16 21:54:31.024587 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:31.024123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68549d7778-h66vs" event={"ID":"e3255045-e221-4dbb-82f2-d5495692e686","Type":"ContainerStarted","Data":"833c2284948362c63f016ba896548443bbb81be2f74f2e8304bac453ddf20d05"} Sep 16 21:54:31.034719 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:31.034689 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-5s8n9" Sep 16 21:54:31.061939 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:31.061886 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68549d7778-h66vs" podStartSLOduration=5.061867694 podStartE2EDuration="5.061867694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:31.042236649 +0000 UTC m=+319.659599509" watchObservedRunningTime="2026-09-16 21:54:31.061867694 +0000 UTC m=+319.679230560" Sep 16 21:54:31.732031 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:31.731997 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:31.832605 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:31.832556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:33.035698 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:33.035665 2575 generic.go:356] "Generic (PLEG): container finished" podID="461bd19e-9421-4cb1-9b1e-7c26bc656388" containerID="dc1e0225e2a3aa9f0e85dcd8582f462a180aba6eebdd00de1e118b98ed57f694" exitCode=0 Sep 16 21:54:33.036197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:33.035749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" event={"ID":"461bd19e-9421-4cb1-9b1e-7c26bc656388","Type":"ContainerDied","Data":"dc1e0225e2a3aa9f0e85dcd8582f462a180aba6eebdd00de1e118b98ed57f694"} Sep 16 21:54:33.036266 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:33.036239 2575 scope.go:117] "RemoveContainer" containerID="dc1e0225e2a3aa9f0e85dcd8582f462a180aba6eebdd00de1e118b98ed57f694" Sep 16 21:54:33.526854 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:33.526824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:33.576956 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:33.576923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:34.042564 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:34.042520 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-tv52t" event={"ID":"461bd19e-9421-4cb1-9b1e-7c26bc656388","Type":"ContainerStarted","Data":"f906d35b81ab1648082214287f93a7e05ede1bc2d43c627bceb43ec98f222f66"} Sep 16 21:54:34.167182 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:34.167139 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:34.267332 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:34.267300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:36.865011 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:36.864976 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:36.865481 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:36.865046 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:36.870571 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:36.870542 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:37.065497 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:37.065462 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:54:37.125874 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:37.125792 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7cb69bb9-2d5ds"] Sep 16 21:54:38.541312 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:38.541272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:38.642496 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:38.642461 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:39.934699 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:39.934669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:39.986759 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:39.986727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:40.465963 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:40.465938 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:40.469648 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:40.469628 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-856bc9bbd7-tbhsq" Sep 16 21:54:43.763342 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:43.763311 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-5srws_24732cb0-e397-49b0-80bd-ff99e0b6164b/cluster-monitoring-operator/0.log" Sep 16 21:54:43.962826 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:43.962797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-9kp75_5abcdbce-fb2f-4547-bb9d-9bfb555613d0/kube-state-metrics/0.log" Sep 16 21:54:44.162356 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:44.162324 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-9kp75_5abcdbce-fb2f-4547-bb9d-9bfb555613d0/kube-rbac-proxy-main/0.log" Sep 16 21:54:44.361670 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:44.361644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-9kp75_5abcdbce-fb2f-4547-bb9d-9bfb555613d0/kube-rbac-proxy-self/0.log" Sep 16 21:54:44.561987 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:44.561899 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-856bc9bbd7-tbhsq_22d542c9-204a-4b7b-bb2f-6adf216ef50f/metrics-server/0.log" Sep 16 21:54:44.962130 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:44.962109 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85gk_d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c/init-textfile/0.log" Sep 16 21:54:45.135795 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:45.135763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:45.162732 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:45.162691 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85gk_d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c/node-exporter/0.log" Sep 16 21:54:45.361423 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:45.361385 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85gk_d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c/kube-rbac-proxy/0.log" Sep 16 21:54:46.763307 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:46.763278 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-p6t9c_17e5a00d-eff9-43e0-8964-5ba04754f5fc/kube-rbac-proxy-main/0.log" Sep 16 21:54:46.962452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:46.962384 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-p6t9c_17e5a00d-eff9-43e0-8964-5ba04754f5fc/kube-rbac-proxy-self/0.log" Sep 16 21:54:47.164616 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:47.164588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-p6t9c_17e5a00d-eff9-43e0-8964-5ba04754f5fc/openshift-state-metrics/0.log" Sep 16 21:54:49.362912 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:49.362813 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74665797c7-nr2rz_af19e1da-8e03-4650-85c5-0e77c65ed601/telemeter-client/0.log" Sep 16 21:54:49.565658 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:49.565628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74665797c7-nr2rz_af19e1da-8e03-4650-85c5-0e77c65ed601/reload/0.log" Sep 16 21:54:49.762976 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:49.762902 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74665797c7-nr2rz_af19e1da-8e03-4650-85c5-0e77c65ed601/kube-rbac-proxy/0.log" Sep 16 21:54:49.962860 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:49.962831 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/thanos-query/0.log" Sep 16 21:54:50.163045 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:50.162992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy-web/0.log" Sep 16 21:54:50.362563 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:50.362534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy/0.log" Sep 16 21:54:50.561699 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:50.561622 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/prom-label-proxy/0.log" Sep 16 21:54:50.761920 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:50.761862 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy-rules/0.log" Sep 16 21:54:50.962354 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:50.962306 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy-metrics/0.log" Sep 16 21:54:51.762440 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:51.762415 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68549d7778-h66vs_e3255045-e221-4dbb-82f2-d5495692e686/console/0.log" Sep 16 21:54:51.962723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:51.962697 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c7cb69bb9-2d5ds_7be3685c-f18a-4420-bad5-058ae3ba75d0/console/0.log" Sep 16 21:54:52.163548 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:52.163523 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-5s8n9_4f226e73-b0be-42dc-819f-000772fdc0bc/download-server/0.log" Sep 16 21:54:54.813770 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:54.813742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:57.272229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:57.272198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:54:57.334427 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:54:57.334393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:02.150451 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.150409 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c7cb69bb9-2d5ds" podUID="7be3685c-f18a-4420-bad5-058ae3ba75d0" containerName="console" containerID="cri-o://8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8" gracePeriod=15 Sep 16 21:55:02.423932 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.423861 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:55:02.477819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.477785 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-serving-cert\") pod \"7be3685c-f18a-4420-bad5-058ae3ba75d0\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " Sep 16 21:55:02.477951 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.477834 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-oauth-serving-cert\") pod \"7be3685c-f18a-4420-bad5-058ae3ba75d0\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " Sep 16 21:55:02.477951 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.477880 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-oauth-config\") pod \"7be3685c-f18a-4420-bad5-058ae3ba75d0\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " Sep 16 21:55:02.477951 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.477911 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-config\") pod \"7be3685c-f18a-4420-bad5-058ae3ba75d0\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " Sep 16 21:55:02.477951 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.477928 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqknf\" (UniqueName: \"kubernetes.io/projected/7be3685c-f18a-4420-bad5-058ae3ba75d0-kube-api-access-kqknf\") pod \"7be3685c-f18a-4420-bad5-058ae3ba75d0\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " Sep 16 21:55:02.478186 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.477971 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-service-ca\") pod \"7be3685c-f18a-4420-bad5-058ae3ba75d0\" (UID: \"7be3685c-f18a-4420-bad5-058ae3ba75d0\") " Sep 16 21:55:02.478358 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.478318 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7be3685c-f18a-4420-bad5-058ae3ba75d0" (UID: "7be3685c-f18a-4420-bad5-058ae3ba75d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:02.478444 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.478361 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-config" (OuterVolumeSpecName: "console-config") pod "7be3685c-f18a-4420-bad5-058ae3ba75d0" (UID: "7be3685c-f18a-4420-bad5-058ae3ba75d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:02.478444 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.478384 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "7be3685c-f18a-4420-bad5-058ae3ba75d0" (UID: "7be3685c-f18a-4420-bad5-058ae3ba75d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:02.480288 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.480259 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7be3685c-f18a-4420-bad5-058ae3ba75d0" (UID: "7be3685c-f18a-4420-bad5-058ae3ba75d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 21:55:02.480402 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.480370 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be3685c-f18a-4420-bad5-058ae3ba75d0-kube-api-access-kqknf" (OuterVolumeSpecName: "kube-api-access-kqknf") pod "7be3685c-f18a-4420-bad5-058ae3ba75d0" (UID: "7be3685c-f18a-4420-bad5-058ae3ba75d0"). InnerVolumeSpecName "kube-api-access-kqknf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:55:02.480402 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.480387 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7be3685c-f18a-4420-bad5-058ae3ba75d0" (UID: "7be3685c-f18a-4420-bad5-058ae3ba75d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 21:55:02.579028 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.578994 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-oauth-config\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:02.579028 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.579020 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-config\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:02.579028 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.579029 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqknf\" (UniqueName: \"kubernetes.io/projected/7be3685c-f18a-4420-bad5-058ae3ba75d0-kube-api-access-kqknf\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:02.579028 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.579038 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-service-ca\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:02.579294 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.579047 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7be3685c-f18a-4420-bad5-058ae3ba75d0-console-serving-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:02.579294 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:02.579055 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7be3685c-f18a-4420-bad5-058ae3ba75d0-oauth-serving-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:03.176461 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.176427 2575 generic.go:356] "Generic (PLEG): container finished" podID="7be3685c-f18a-4420-bad5-058ae3ba75d0" containerID="8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8" exitCode=0 Sep 16 21:55:03.176943 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.176480 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7cb69bb9-2d5ds" Sep 16 21:55:03.176943 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.176495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7cb69bb9-2d5ds" event={"ID":"7be3685c-f18a-4420-bad5-058ae3ba75d0","Type":"ContainerDied","Data":"8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8"} Sep 16 21:55:03.176943 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.176543 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7cb69bb9-2d5ds" event={"ID":"7be3685c-f18a-4420-bad5-058ae3ba75d0","Type":"ContainerDied","Data":"edfe1dfdb85562cad46cd82929f8eaa0b55953bb61b904f4085d05a6d47448c7"} Sep 16 21:55:03.176943 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.176570 2575 scope.go:117] "RemoveContainer" containerID="8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8" Sep 16 21:55:03.200223 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.186390 2575 scope.go:117] "RemoveContainer" containerID="8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8" Sep 16 21:55:03.200223 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:55:03.186725 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8\": container with ID starting with 8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8 not found: ID does not exist" containerID="8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8" Sep 16 21:55:03.200223 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.186757 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8"} err="failed to get container status \"8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8\": rpc error: code = NotFound desc = could not find container \"8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8\": container with ID starting with 8d582eac8ae4de55a6f0c63d20c61de7e7aa0873d924cf16f66332ffea9f6ab8 not found: ID does not exist" Sep 16 21:55:03.204088 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.203280 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7cb69bb9-2d5ds"] Sep 16 21:55:03.210042 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.210017 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c7cb69bb9-2d5ds"] Sep 16 21:55:03.884961 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:03.884929 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7be3685c-f18a-4420-bad5-058ae3ba75d0" path="/var/lib/kubelet/pods/7be3685c-f18a-4420-bad5-058ae3ba75d0/volumes" Sep 16 21:55:04.175222 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:04.175137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:04.235219 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:04.235187 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:11.904548 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:11.904520 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:11.961908 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:11.961878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:18.292096 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.292040 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 21:55:18.292670 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.292527 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7be3685c-f18a-4420-bad5-058ae3ba75d0" containerName="console" Sep 16 21:55:18.292670 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.292547 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7be3685c-f18a-4420-bad5-058ae3ba75d0" containerName="console" Sep 16 21:55:18.292670 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.292639 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7be3685c-f18a-4420-bad5-058ae3ba75d0" containerName="console" Sep 16 21:55:18.296346 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.296322 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.299631 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.299610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 16 21:55:18.299746 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.299609 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 16 21:55:18.299943 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.299892 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 16 21:55:18.299993 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.299933 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 16 21:55:18.300218 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.300204 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bfx8s\"" Sep 16 21:55:18.300302 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.300285 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 16 21:55:18.300380 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.300364 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 16 21:55:18.300433 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.300377 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 16 21:55:18.300796 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.300782 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 16 21:55:18.307015 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.306997 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 16 21:55:18.314051 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.314026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 21:55:18.413543 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-config-volume\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f438fe0a-8d92-4465-a856-75e307f99dde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f438fe0a-8d92-4465-a856-75e307f99dde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-web-config\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f438fe0a-8d92-4465-a856-75e307f99dde-config-out\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f438fe0a-8d92-4465-a856-75e307f99dde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f438fe0a-8d92-4465-a856-75e307f99dde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djbmm\" (UniqueName: \"kubernetes.io/projected/f438fe0a-8d92-4465-a856-75e307f99dde-kube-api-access-djbmm\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.413986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.413892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.514870 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.514835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f438fe0a-8d92-4465-a856-75e307f99dde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.514986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.514875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djbmm\" (UniqueName: \"kubernetes.io/projected/f438fe0a-8d92-4465-a856-75e307f99dde-kube-api-access-djbmm\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.514986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.514895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.514986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.514925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.514989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-config-volume\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f438fe0a-8d92-4465-a856-75e307f99dde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f438fe0a-8d92-4465-a856-75e307f99dde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-web-config\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f438fe0a-8d92-4465-a856-75e307f99dde-config-out\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515265 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f438fe0a-8d92-4465-a856-75e307f99dde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.515457 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.515323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f438fe0a-8d92-4465-a856-75e307f99dde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.516376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.516352 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f438fe0a-8d92-4465-a856-75e307f99dde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.517111 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.517091 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f438fe0a-8d92-4465-a856-75e307f99dde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.518416 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.518416 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-config-volume\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.518578 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518533 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.518578 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518554 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.518694 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.518777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f438fe0a-8d92-4465-a856-75e307f99dde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.519006 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.518792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.519479 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.519460 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f438fe0a-8d92-4465-a856-75e307f99dde-web-config\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.520290 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.520273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f438fe0a-8d92-4465-a856-75e307f99dde-config-out\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.526187 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.526166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djbmm\" (UniqueName: \"kubernetes.io/projected/f438fe0a-8d92-4465-a856-75e307f99dde-kube-api-access-djbmm\") pod \"alertmanager-main-0\" (UID: \"f438fe0a-8d92-4465-a856-75e307f99dde\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.606957 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.606933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 21:55:18.886798 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:18.886780 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 21:55:18.889225 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:55:18.889196 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf438fe0a_8d92_4465_a856_75e307f99dde.slice/crio-87d04d42a3d5c75fd91173f53aeb72744cdb1324252910f38ecf3002ed53420b WatchSource:0}: Error finding container 87d04d42a3d5c75fd91173f53aeb72744cdb1324252910f38ecf3002ed53420b: Status 404 returned error can't find the container with id 87d04d42a3d5c75fd91173f53aeb72744cdb1324252910f38ecf3002ed53420b Sep 16 21:55:19.243053 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.242953 2575 generic.go:356] "Generic (PLEG): container finished" podID="f438fe0a-8d92-4465-a856-75e307f99dde" containerID="1aae153b2b6eb8e283c6bc48ce41ddfd4edafecdf04c4f09975d10bbc92c941a" exitCode=0 Sep 16 21:55:19.243244 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.243119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerDied","Data":"1aae153b2b6eb8e283c6bc48ce41ddfd4edafecdf04c4f09975d10bbc92c941a"} Sep 16 21:55:19.243244 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.243186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"87d04d42a3d5c75fd91173f53aeb72744cdb1324252910f38ecf3002ed53420b"} Sep 16 21:55:19.344860 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.344829 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5877659df4-r6trv"] Sep 16 21:55:19.347598 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.347581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.370630 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.370601 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5877659df4-r6trv"] Sep 16 21:55:19.426784 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.426755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:19.523111 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-config\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.523111 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-oauth-config\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.523287 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-oauth-serving-cert\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.523287 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-serving-cert\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.523374 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523287 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-trusted-ca-bundle\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.523374 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-service-ca\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.523374 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.523351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c4f8\" (UniqueName: \"kubernetes.io/projected/9e098fd2-bf76-4856-ba18-330392d3cbf9-kube-api-access-4c4f8\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.535481 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.535449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:19.624109 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-serving-cert\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-trusted-ca-bundle\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-service-ca\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c4f8\" (UniqueName: \"kubernetes.io/projected/9e098fd2-bf76-4856-ba18-330392d3cbf9-kube-api-access-4c4f8\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-config\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-oauth-config\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624333 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-oauth-serving-cert\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.624977 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.624956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-service-ca\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.625104 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.625047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-config\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.625338 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.625318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-oauth-serving-cert\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.625400 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.625381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-trusted-ca-bundle\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.626803 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.626784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-serving-cert\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.626906 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.626812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-oauth-config\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.635143 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.635122 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c4f8\" (UniqueName: \"kubernetes.io/projected/9e098fd2-bf76-4856-ba18-330392d3cbf9-kube-api-access-4c4f8\") pod \"console-5877659df4-r6trv\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.639758 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.639731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:19.656452 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.656434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:19.934366 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:19.934335 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5877659df4-r6trv"] Sep 16 21:55:19.937569 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:55:19.937527 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e098fd2_bf76_4856_ba18_330392d3cbf9.slice/crio-5f904aa8630dd3d25977f23c0d2f5d2dd929f7d2273a7e6f58f1c967b439c88e WatchSource:0}: Error finding container 5f904aa8630dd3d25977f23c0d2f5d2dd929f7d2273a7e6f58f1c967b439c88e: Status 404 returned error can't find the container with id 5f904aa8630dd3d25977f23c0d2f5d2dd929f7d2273a7e6f58f1c967b439c88e Sep 16 21:55:20.164404 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.164368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:20.251412 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.251327 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877659df4-r6trv" event={"ID":"9e098fd2-bf76-4856-ba18-330392d3cbf9","Type":"ContainerStarted","Data":"ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921"} Sep 16 21:55:20.251568 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.251414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877659df4-r6trv" event={"ID":"9e098fd2-bf76-4856-ba18-330392d3cbf9","Type":"ContainerStarted","Data":"5f904aa8630dd3d25977f23c0d2f5d2dd929f7d2273a7e6f58f1c967b439c88e"} Sep 16 21:55:20.257352 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.257315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:20.272563 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.272511 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5877659df4-r6trv" podStartSLOduration=1.272485044 podStartE2EDuration="1.272485044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:20.270738638 +0000 UTC m=+368.888101508" watchObservedRunningTime="2026-09-16 21:55:20.272485044 +0000 UTC m=+368.889847904" Sep 16 21:55:20.382323 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.382290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:20.452723 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:20.452686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:21.258729 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.258694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"8b1c79f000d63c8ba7ec06f1b5cb069b071ef1b0279fab77e7976d67bc74e730"} Sep 16 21:55:21.258928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.258779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"105a6934bcd61ae077fb682ef21e3a75b3fe8d08d91a3725f0fc888de2f5a64d"} Sep 16 21:55:21.258928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.258828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"e50993a0f397c606ce36e5e1a34616b784561f06ee524fbcb0f66b458e76f237"} Sep 16 21:55:21.258928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.258869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"463693ea2636204d6ce17de3fb2f4e670e2623b43f805b8182ba8a0c196f5270"} Sep 16 21:55:21.258928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.258908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"d303cafe4b9e1ddb7cfe36581f5fc6a2bd30e4ee25366278f4ee1408b92dfbb9"} Sep 16 21:55:21.259166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.258946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f438fe0a-8d92-4465-a856-75e307f99dde","Type":"ContainerStarted","Data":"b8d9fd4c8e1d60af188bbaf665dcd7b9949f460d14fe79c1a8efc0eec1b5bf60"} Sep 16 21:55:21.286571 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:21.286479 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.75873273 podStartE2EDuration="3.2864641s" totalImagesPullingTime="1.511726384s" totalInitContainerRuntime="16.004986ms" isStatefulPod=false podCreationTimestamp="2026-09-16 21:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:21.284704855 +0000 UTC m=+369.902067715" watchObservedRunningTime="2026-09-16 21:55:21.2864641 +0000 UTC m=+369.903826960" Sep 16 21:55:23.689529 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:23.689493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:23.764782 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:23.764748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:25.682550 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:25.682513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:55:25.684994 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:25.684974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e-metrics-certs\") pod \"network-metrics-daemon-wvmvr\" (UID: \"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e\") " pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:55:25.884202 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:25.884175 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cplt\"" Sep 16 21:55:25.892297 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:25.892274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wvmvr" Sep 16 21:55:26.161188 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:26.161162 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wvmvr"] Sep 16 21:55:26.163258 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:55:26.163228 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d0bb3d_f5e8_4f85_bbda_89a8838c6e8e.slice/crio-ac32de5151ae178e09ee7089e25d9b4e50b66893dd40c4754d972a1a240bf5fc WatchSource:0}: Error finding container ac32de5151ae178e09ee7089e25d9b4e50b66893dd40c4754d972a1a240bf5fc: Status 404 returned error can't find the container with id ac32de5151ae178e09ee7089e25d9b4e50b66893dd40c4754d972a1a240bf5fc Sep 16 21:55:26.279408 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:26.279329 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wvmvr" event={"ID":"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e","Type":"ContainerStarted","Data":"ac32de5151ae178e09ee7089e25d9b4e50b66893dd40c4754d972a1a240bf5fc"} Sep 16 21:55:27.284806 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:27.284780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wvmvr" event={"ID":"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e","Type":"ContainerStarted","Data":"2e164a3cfd48628df5e19294fa17bba75d403019a2bbe6cf59d0aa6a067f7c92"} Sep 16 21:55:28.291201 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:28.291166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wvmvr" event={"ID":"72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e","Type":"ContainerStarted","Data":"09c47bca62c82f7a7e8ea140913aad93cbe5b5c2393f20404d63599a8c6f746c"} Sep 16 21:55:28.306831 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:28.306782 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wvmvr" podStartSLOduration=375.33868421 podStartE2EDuration="6m16.306766393s" totalImagesPullingTime="968.082183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:28.306002959 +0000 UTC m=+376.923365832" watchObservedRunningTime="2026-09-16 21:55:28.306766393 +0000 UTC m=+376.924129287" Sep 16 21:55:28.388514 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:28.388486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:28.442258 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:28.442224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:29.401497 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:29.401465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:29.456194 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:29.456166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:29.657025 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:29.656940 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:29.657197 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:29.657105 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:29.661808 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:29.661786 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:30.303414 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:30.303384 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5877659df4-r6trv" Sep 16 21:55:30.347250 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:30.347222 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68549d7778-h66vs"] Sep 16 21:55:30.451947 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:30.451913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:30.506928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:30.506887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:30.556909 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:30.556820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:34.180027 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:34.179993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:34.280708 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:34.280675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:48.415405 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:48.415364 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:48.520038 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:48.519983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:55:55.370026 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.369985 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68549d7778-h66vs" podUID="e3255045-e221-4dbb-82f2-d5495692e686" containerName="console" containerID="cri-o://d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be" gracePeriod=15 Sep 16 21:55:55.614850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.614827 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:55:55.738735 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738647 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-console-config\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.738735 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738691 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-service-ca\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.738735 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738723 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-oauth-config\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.738999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738779 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-oauth-serving-cert\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.738999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738825 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-serving-cert\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.738999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738878 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-trusted-ca-bundle\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.738999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.738918 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztw9r\" (UniqueName: \"kubernetes.io/projected/e3255045-e221-4dbb-82f2-d5495692e686-kube-api-access-ztw9r\") pod \"e3255045-e221-4dbb-82f2-d5495692e686\" (UID: \"e3255045-e221-4dbb-82f2-d5495692e686\") " Sep 16 21:55:55.739233 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.739121 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-console-config" (OuterVolumeSpecName: "console-config") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:55.739289 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.739245 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:55.739341 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.739293 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:55.739341 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.739303 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 21:55:55.741126 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.741095 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 21:55:55.741259 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.741223 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3255045-e221-4dbb-82f2-d5495692e686-kube-api-access-ztw9r" (OuterVolumeSpecName: "kube-api-access-ztw9r") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "kube-api-access-ztw9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:55:55.741259 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.741249 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3255045-e221-4dbb-82f2-d5495692e686" (UID: "e3255045-e221-4dbb-82f2-d5495692e686"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 21:55:55.840280 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840238 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-serving-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:55.840280 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840275 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-trusted-ca-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:55.840280 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840285 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztw9r\" (UniqueName: \"kubernetes.io/projected/e3255045-e221-4dbb-82f2-d5495692e686-kube-api-access-ztw9r\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:55.840280 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840296 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-console-config\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:55.840543 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840304 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-service-ca\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:55.840543 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840311 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3255045-e221-4dbb-82f2-d5495692e686-console-oauth-config\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:55.840543 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:55.840319 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3255045-e221-4dbb-82f2-d5495692e686-oauth-serving-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:55:56.405654 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.405619 2575 generic.go:356] "Generic (PLEG): container finished" podID="e3255045-e221-4dbb-82f2-d5495692e686" containerID="d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be" exitCode=0 Sep 16 21:55:56.406086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.405662 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68549d7778-h66vs" Sep 16 21:55:56.406086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.405669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68549d7778-h66vs" event={"ID":"e3255045-e221-4dbb-82f2-d5495692e686","Type":"ContainerDied","Data":"d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be"} Sep 16 21:55:56.406086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.405710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68549d7778-h66vs" event={"ID":"e3255045-e221-4dbb-82f2-d5495692e686","Type":"ContainerDied","Data":"833c2284948362c63f016ba896548443bbb81be2f74f2e8304bac453ddf20d05"} Sep 16 21:55:56.406086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.405730 2575 scope.go:117] "RemoveContainer" containerID="d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be" Sep 16 21:55:56.414096 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.414058 2575 scope.go:117] "RemoveContainer" containerID="d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be" Sep 16 21:55:56.414386 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:55:56.414365 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be\": container with ID starting with d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be not found: ID does not exist" containerID="d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be" Sep 16 21:55:56.414477 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.414391 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be"} err="failed to get container status \"d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be\": rpc error: code = NotFound desc = could not find container \"d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be\": container with ID starting with d6a7fda427c40ad0abe760a78a8f406f3462b2f7dc6a1e1a8cc6bec120eda5be not found: ID does not exist" Sep 16 21:55:56.421775 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.421735 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68549d7778-h66vs"] Sep 16 21:55:56.423206 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:56.423187 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68549d7778-h66vs"] Sep 16 21:55:57.885448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:55:57.885409 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3255045-e221-4dbb-82f2-d5495692e686" path="/var/lib/kubelet/pods/e3255045-e221-4dbb-82f2-d5495692e686/volumes" Sep 16 21:56:11.571917 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:11.571875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:12.730898 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:12.730864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:12.782345 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:12.782302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:17.055216 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.055178 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:17.151205 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.151172 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:17.689341 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.689304 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht"] Sep 16 21:56:17.689680 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.689668 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3255045-e221-4dbb-82f2-d5495692e686" containerName="console" Sep 16 21:56:17.689721 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.689683 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3255045-e221-4dbb-82f2-d5495692e686" containerName="console" Sep 16 21:56:17.689755 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.689746 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3255045-e221-4dbb-82f2-d5495692e686" containerName="console" Sep 16 21:56:17.693109 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.693091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.695925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.695905 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m5cww\"" Sep 16 21:56:17.695925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.695922 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 16 21:56:17.696099 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.695956 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 16 21:56:17.700748 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.700728 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht"] Sep 16 21:56:17.722141 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.722117 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.722273 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.722188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndpvm\" (UniqueName: \"kubernetes.io/projected/503b26ef-b1eb-428e-87cf-7896949a04f4-kube-api-access-ndpvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.722273 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.722226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.822696 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.822662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndpvm\" (UniqueName: \"kubernetes.io/projected/503b26ef-b1eb-428e-87cf-7896949a04f4-kube-api-access-ndpvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.822853 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.822728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.822853 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.822762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.823209 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.823188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.823209 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.823200 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:17.831253 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:17.831224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndpvm\" (UniqueName: \"kubernetes.io/projected/503b26ef-b1eb-428e-87cf-7896949a04f4-kube-api-access-ndpvm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:18.004060 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:18.003962 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:18.273714 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:18.273627 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht"] Sep 16 21:56:18.276622 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:56:18.276596 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503b26ef_b1eb_428e_87cf_7896949a04f4.slice/crio-56519e6acae53340e848afa9d5175661f0ea2765fa2cb83dacd3028a93638ceb WatchSource:0}: Error finding container 56519e6acae53340e848afa9d5175661f0ea2765fa2cb83dacd3028a93638ceb: Status 404 returned error can't find the container with id 56519e6acae53340e848afa9d5175661f0ea2765fa2cb83dacd3028a93638ceb Sep 16 21:56:18.498364 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:18.498326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" event={"ID":"503b26ef-b1eb-428e-87cf-7896949a04f4","Type":"ContainerStarted","Data":"56519e6acae53340e848afa9d5175661f0ea2765fa2cb83dacd3028a93638ceb"} Sep 16 21:56:24.526249 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:24.526213 2575 generic.go:356] "Generic (PLEG): container finished" podID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerID="ee2dc6e5811d967a355d92391e222c51db6bfb780d6e613931def5b316c4afa3" exitCode=0 Sep 16 21:56:24.526644 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:24.526285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" event={"ID":"503b26ef-b1eb-428e-87cf-7896949a04f4","Type":"ContainerDied","Data":"ee2dc6e5811d967a355d92391e222c51db6bfb780d6e613931def5b316c4afa3"} Sep 16 21:56:27.542610 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:27.542577 2575 generic.go:356] "Generic (PLEG): container finished" podID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerID="f592d3dda0d644487b6bbbbe23e6b2bc8d5e8f8d2e7db862d09ae725087394da" exitCode=0 Sep 16 21:56:27.542969 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:27.542643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" event={"ID":"503b26ef-b1eb-428e-87cf-7896949a04f4","Type":"ContainerDied","Data":"f592d3dda0d644487b6bbbbe23e6b2bc8d5e8f8d2e7db862d09ae725087394da"} Sep 16 21:56:29.277280 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:29.277235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:29.334649 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:29.334593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:34.576134 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:34.576098 2575 generic.go:356] "Generic (PLEG): container finished" podID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerID="eaf092528885d86dbefdc4af6f86cf962ff4eabac4ab7aeff0ade981331a52dd" exitCode=0 Sep 16 21:56:34.576509 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:34.576165 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" event={"ID":"503b26ef-b1eb-428e-87cf-7896949a04f4","Type":"ContainerDied","Data":"eaf092528885d86dbefdc4af6f86cf962ff4eabac4ab7aeff0ade981331a52dd"} Sep 16 21:56:35.708193 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.708167 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:35.782096 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.782048 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-bundle\") pod \"503b26ef-b1eb-428e-87cf-7896949a04f4\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " Sep 16 21:56:35.782249 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.782124 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndpvm\" (UniqueName: \"kubernetes.io/projected/503b26ef-b1eb-428e-87cf-7896949a04f4-kube-api-access-ndpvm\") pod \"503b26ef-b1eb-428e-87cf-7896949a04f4\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " Sep 16 21:56:35.782249 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.782218 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-util\") pod \"503b26ef-b1eb-428e-87cf-7896949a04f4\" (UID: \"503b26ef-b1eb-428e-87cf-7896949a04f4\") " Sep 16 21:56:35.782838 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.782813 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-bundle" (OuterVolumeSpecName: "bundle") pod "503b26ef-b1eb-428e-87cf-7896949a04f4" (UID: "503b26ef-b1eb-428e-87cf-7896949a04f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:56:35.784483 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.784445 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503b26ef-b1eb-428e-87cf-7896949a04f4-kube-api-access-ndpvm" (OuterVolumeSpecName: "kube-api-access-ndpvm") pod "503b26ef-b1eb-428e-87cf-7896949a04f4" (UID: "503b26ef-b1eb-428e-87cf-7896949a04f4"). InnerVolumeSpecName "kube-api-access-ndpvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:56:35.786895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.786873 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-util" (OuterVolumeSpecName: "util") pod "503b26ef-b1eb-428e-87cf-7896949a04f4" (UID: "503b26ef-b1eb-428e-87cf-7896949a04f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:56:35.882925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.882888 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:56:35.882925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.882911 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/503b26ef-b1eb-428e-87cf-7896949a04f4-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:56:35.882925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:35.882920 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndpvm\" (UniqueName: \"kubernetes.io/projected/503b26ef-b1eb-428e-87cf-7896949a04f4-kube-api-access-ndpvm\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:56:36.587896 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:36.587864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" event={"ID":"503b26ef-b1eb-428e-87cf-7896949a04f4","Type":"ContainerDied","Data":"56519e6acae53340e848afa9d5175661f0ea2765fa2cb83dacd3028a93638ceb"} Sep 16 21:56:36.587896 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:36.587895 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754097kht" Sep 16 21:56:36.588114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:36.587908 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56519e6acae53340e848afa9d5175661f0ea2765fa2cb83dacd3028a93638ceb" Sep 16 21:56:38.662771 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:38.662735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:39.478978 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:39.478941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:40.641701 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.641665 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z"] Sep 16 21:56:40.642055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642037 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="pull" Sep 16 21:56:40.642055 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642048 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="pull" Sep 16 21:56:40.642154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642076 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="util" Sep 16 21:56:40.642154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642086 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="util" Sep 16 21:56:40.642154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642101 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="extract" Sep 16 21:56:40.642154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642106 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="extract" Sep 16 21:56:40.642269 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.642166 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="503b26ef-b1eb-428e-87cf-7896949a04f4" containerName="extract" Sep 16 21:56:40.671933 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.671898 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z"] Sep 16 21:56:40.672180 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.672016 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.674740 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.674721 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 16 21:56:40.674740 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.674731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-whv2w\"" Sep 16 21:56:40.674901 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.674835 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 16 21:56:40.721715 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.721680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/960f8b4f-9054-4ddf-b84c-b0e311a0011d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v985z\" (UID: \"960f8b4f-9054-4ddf-b84c-b0e311a0011d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.721874 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.721750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2dr\" (UniqueName: \"kubernetes.io/projected/960f8b4f-9054-4ddf-b84c-b0e311a0011d-kube-api-access-4k2dr\") pod \"cert-manager-operator-controller-manager-55c444bf86-v985z\" (UID: \"960f8b4f-9054-4ddf-b84c-b0e311a0011d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.823037 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.822996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/960f8b4f-9054-4ddf-b84c-b0e311a0011d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v985z\" (UID: \"960f8b4f-9054-4ddf-b84c-b0e311a0011d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.823229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.823117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2dr\" (UniqueName: \"kubernetes.io/projected/960f8b4f-9054-4ddf-b84c-b0e311a0011d-kube-api-access-4k2dr\") pod \"cert-manager-operator-controller-manager-55c444bf86-v985z\" (UID: \"960f8b4f-9054-4ddf-b84c-b0e311a0011d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.823474 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.823452 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/960f8b4f-9054-4ddf-b84c-b0e311a0011d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v985z\" (UID: \"960f8b4f-9054-4ddf-b84c-b0e311a0011d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.831636 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.831617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2dr\" (UniqueName: \"kubernetes.io/projected/960f8b4f-9054-4ddf-b84c-b0e311a0011d-kube-api-access-4k2dr\") pod \"cert-manager-operator-controller-manager-55c444bf86-v985z\" (UID: \"960f8b4f-9054-4ddf-b84c-b0e311a0011d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:40.982166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:40.982085 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" Sep 16 21:56:41.274198 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:41.274175 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z"] Sep 16 21:56:41.276021 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:56:41.275994 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960f8b4f_9054_4ddf_b84c_b0e311a0011d.slice/crio-a5d6c9288bd2edbf803bda14b05a13465ae18d57f815b68baca78f01f2f5e2d4 WatchSource:0}: Error finding container a5d6c9288bd2edbf803bda14b05a13465ae18d57f815b68baca78f01f2f5e2d4: Status 404 returned error can't find the container with id a5d6c9288bd2edbf803bda14b05a13465ae18d57f815b68baca78f01f2f5e2d4 Sep 16 21:56:41.609469 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:41.609436 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" event={"ID":"960f8b4f-9054-4ddf-b84c-b0e311a0011d","Type":"ContainerStarted","Data":"a5d6c9288bd2edbf803bda14b05a13465ae18d57f815b68baca78f01f2f5e2d4"} Sep 16 21:56:42.268421 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:42.268380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:42.325852 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:42.325816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:44.352147 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:44.352104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:44.451858 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:44.451829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:44.624528 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:44.624447 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" event={"ID":"960f8b4f-9054-4ddf-b84c-b0e311a0011d","Type":"ContainerStarted","Data":"3ae1558f66ed7b53179a610fbe55abaa9ede4ea0b2e1c645f39f45abf3ed72de"} Sep 16 21:56:44.646518 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:44.646469 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v985z" podStartSLOduration=2.310738194 podStartE2EDuration="4.646452621s" totalImagesPullingTime="2.335714427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:56:44.643999061 +0000 UTC m=+453.261361912" watchObservedRunningTime="2026-09-16 21:56:44.646452621 +0000 UTC m=+453.263815480" Sep 16 21:56:44.992278 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:44.992195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:45.105412 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.105378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:45.203773 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.203740 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq"] Sep 16 21:56:45.223022 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.222982 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.225885 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.225860 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq"] Sep 16 21:56:45.226500 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.226472 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m5cww\"" Sep 16 21:56:45.226625 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.226584 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 16 21:56:45.226625 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.226611 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 16 21:56:45.367448 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.367416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4sfm\" (UniqueName: \"kubernetes.io/projected/488c4952-eef6-4357-ac25-3969be8391b1-kube-api-access-g4sfm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.367819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.367454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.367819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.367548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.468123 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.468088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.468305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.468153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.468305 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.468211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4sfm\" (UniqueName: \"kubernetes.io/projected/488c4952-eef6-4357-ac25-3969be8391b1-kube-api-access-g4sfm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.468429 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.468407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.468544 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.468522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.479794 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.479771 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4sfm\" (UniqueName: \"kubernetes.io/projected/488c4952-eef6-4357-ac25-3969be8391b1-kube-api-access-g4sfm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.534781 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.534748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:45.827403 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:45.827371 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq"] Sep 16 21:56:45.829457 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:56:45.829425 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488c4952_eef6_4357_ac25_3969be8391b1.slice/crio-00aa8a008ca04307c509f8298117b9c9a0ea7317be800a246b8987d264c899e8 WatchSource:0}: Error finding container 00aa8a008ca04307c509f8298117b9c9a0ea7317be800a246b8987d264c899e8: Status 404 returned error can't find the container with id 00aa8a008ca04307c509f8298117b9c9a0ea7317be800a246b8987d264c899e8 Sep 16 21:56:46.554022 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:46.553984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:46.635612 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:46.635574 2575 generic.go:356] "Generic (PLEG): container finished" podID="488c4952-eef6-4357-ac25-3969be8391b1" containerID="2357fbab8722382a9774fa5b1a7e5a0d63bfda7f0ca98c0ccffda331e0310aee" exitCode=0 Sep 16 21:56:46.635772 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:46.635662 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" event={"ID":"488c4952-eef6-4357-ac25-3969be8391b1","Type":"ContainerDied","Data":"2357fbab8722382a9774fa5b1a7e5a0d63bfda7f0ca98c0ccffda331e0310aee"} Sep 16 21:56:46.635772 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:46.635711 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" event={"ID":"488c4952-eef6-4357-ac25-3969be8391b1","Type":"ContainerStarted","Data":"00aa8a008ca04307c509f8298117b9c9a0ea7317be800a246b8987d264c899e8"} Sep 16 21:56:47.357611 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:47.357573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:49.071147 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.071048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:49.125907 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.125876 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:49.551258 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.551223 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2974q"] Sep 16 21:56:49.553441 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.553424 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.556344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.556328 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 16 21:56:49.557505 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.557490 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 16 21:56:49.557557 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.557491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mjsnx\"" Sep 16 21:56:49.569341 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.569313 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2974q"] Sep 16 21:56:49.653502 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.653471 2575 generic.go:356] "Generic (PLEG): container finished" podID="488c4952-eef6-4357-ac25-3969be8391b1" containerID="498c2fa65f9ffbc3d1a3a336da51fab27bdc6690271e17e6cc8f42f54d5c2236" exitCode=0 Sep 16 21:56:49.653662 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.653566 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" event={"ID":"488c4952-eef6-4357-ac25-3969be8391b1","Type":"ContainerDied","Data":"498c2fa65f9ffbc3d1a3a336da51fab27bdc6690271e17e6cc8f42f54d5c2236"} Sep 16 21:56:49.709977 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.709953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfr42\" (UniqueName: \"kubernetes.io/projected/a0daaff3-7e07-4e78-b631-f25664fdb761-kube-api-access-nfr42\") pod \"cert-manager-cainjector-559cdd8c87-2974q\" (UID: \"a0daaff3-7e07-4e78-b631-f25664fdb761\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.710087 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.710021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0daaff3-7e07-4e78-b631-f25664fdb761-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2974q\" (UID: \"a0daaff3-7e07-4e78-b631-f25664fdb761\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.811309 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.811242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0daaff3-7e07-4e78-b631-f25664fdb761-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2974q\" (UID: \"a0daaff3-7e07-4e78-b631-f25664fdb761\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.811421 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.811321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfr42\" (UniqueName: \"kubernetes.io/projected/a0daaff3-7e07-4e78-b631-f25664fdb761-kube-api-access-nfr42\") pod \"cert-manager-cainjector-559cdd8c87-2974q\" (UID: \"a0daaff3-7e07-4e78-b631-f25664fdb761\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.819200 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.819172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0daaff3-7e07-4e78-b631-f25664fdb761-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2974q\" (UID: \"a0daaff3-7e07-4e78-b631-f25664fdb761\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.819293 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.819219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfr42\" (UniqueName: \"kubernetes.io/projected/a0daaff3-7e07-4e78-b631-f25664fdb761-kube-api-access-nfr42\") pod \"cert-manager-cainjector-559cdd8c87-2974q\" (UID: \"a0daaff3-7e07-4e78-b631-f25664fdb761\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:49.875237 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:49.875201 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" Sep 16 21:56:50.144945 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:50.144918 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2974q"] Sep 16 21:56:50.147339 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:56:50.147313 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0daaff3_7e07_4e78_b631_f25664fdb761.slice/crio-606ee1eebfd8d88835e24f16a5f570f8091c4ca9b2ef905cf35a9c358ff19f7d WatchSource:0}: Error finding container 606ee1eebfd8d88835e24f16a5f570f8091c4ca9b2ef905cf35a9c358ff19f7d: Status 404 returned error can't find the container with id 606ee1eebfd8d88835e24f16a5f570f8091c4ca9b2ef905cf35a9c358ff19f7d Sep 16 21:56:50.660144 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:50.660110 2575 generic.go:356] "Generic (PLEG): container finished" podID="488c4952-eef6-4357-ac25-3969be8391b1" containerID="05b37335174dbaf8adce88463cd3125da4b22ecbca6576d1809872acbb7775f1" exitCode=0 Sep 16 21:56:50.660312 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:50.660201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" event={"ID":"488c4952-eef6-4357-ac25-3969be8391b1","Type":"ContainerDied","Data":"05b37335174dbaf8adce88463cd3125da4b22ecbca6576d1809872acbb7775f1"} Sep 16 21:56:50.661451 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:50.661428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" event={"ID":"a0daaff3-7e07-4e78-b631-f25664fdb761","Type":"ContainerStarted","Data":"606ee1eebfd8d88835e24f16a5f570f8091c4ca9b2ef905cf35a9c358ff19f7d"} Sep 16 21:56:51.815947 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.815922 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:51.933057 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.932994 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-bundle\") pod \"488c4952-eef6-4357-ac25-3969be8391b1\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " Sep 16 21:56:51.933057 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.933034 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-util\") pod \"488c4952-eef6-4357-ac25-3969be8391b1\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " Sep 16 21:56:51.933314 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.933190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4sfm\" (UniqueName: \"kubernetes.io/projected/488c4952-eef6-4357-ac25-3969be8391b1-kube-api-access-g4sfm\") pod \"488c4952-eef6-4357-ac25-3969be8391b1\" (UID: \"488c4952-eef6-4357-ac25-3969be8391b1\") " Sep 16 21:56:51.933437 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.933415 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-bundle" (OuterVolumeSpecName: "bundle") pod "488c4952-eef6-4357-ac25-3969be8391b1" (UID: "488c4952-eef6-4357-ac25-3969be8391b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:56:51.935622 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.935596 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/488c4952-eef6-4357-ac25-3969be8391b1-kube-api-access-g4sfm" (OuterVolumeSpecName: "kube-api-access-g4sfm") pod "488c4952-eef6-4357-ac25-3969be8391b1" (UID: "488c4952-eef6-4357-ac25-3969be8391b1"). InnerVolumeSpecName "kube-api-access-g4sfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:56:51.940162 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:51.940118 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-util" (OuterVolumeSpecName: "util") pod "488c4952-eef6-4357-ac25-3969be8391b1" (UID: "488c4952-eef6-4357-ac25-3969be8391b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:56:52.035322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.035253 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4sfm\" (UniqueName: \"kubernetes.io/projected/488c4952-eef6-4357-ac25-3969be8391b1-kube-api-access-g4sfm\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:56:52.035322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.035285 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:56:52.035322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.035299 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/488c4952-eef6-4357-ac25-3969be8391b1-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:56:52.337289 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337196 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ghxqh"] Sep 16 21:56:52.337636 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337619 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="util" Sep 16 21:56:52.337636 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337637 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="util" Sep 16 21:56:52.337752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337655 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="pull" Sep 16 21:56:52.337752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337662 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="pull" Sep 16 21:56:52.337752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337694 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="extract" Sep 16 21:56:52.337752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337703 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="extract" Sep 16 21:56:52.337899 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.337793 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="488c4952-eef6-4357-ac25-3969be8391b1" containerName="extract" Sep 16 21:56:52.340793 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.340769 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.349881 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.343465 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mxqs8\"" Sep 16 21:56:52.354212 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.354185 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ghxqh"] Sep 16 21:56:52.437999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.437958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7512f5d5-26b1-4d49-b622-5bcc5418ddc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ghxqh\" (UID: \"7512f5d5-26b1-4d49-b622-5bcc5418ddc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.438185 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.438153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnt8\" (UniqueName: \"kubernetes.io/projected/7512f5d5-26b1-4d49-b622-5bcc5418ddc9-kube-api-access-9mnt8\") pod \"cert-manager-webhook-6486ffd997-ghxqh\" (UID: \"7512f5d5-26b1-4d49-b622-5bcc5418ddc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.538698 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.538662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnt8\" (UniqueName: \"kubernetes.io/projected/7512f5d5-26b1-4d49-b622-5bcc5418ddc9-kube-api-access-9mnt8\") pod \"cert-manager-webhook-6486ffd997-ghxqh\" (UID: \"7512f5d5-26b1-4d49-b622-5bcc5418ddc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.538865 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.538735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7512f5d5-26b1-4d49-b622-5bcc5418ddc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ghxqh\" (UID: \"7512f5d5-26b1-4d49-b622-5bcc5418ddc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.547226 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.547191 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7512f5d5-26b1-4d49-b622-5bcc5418ddc9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ghxqh\" (UID: \"7512f5d5-26b1-4d49-b622-5bcc5418ddc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.547226 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.547211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnt8\" (UniqueName: \"kubernetes.io/projected/7512f5d5-26b1-4d49-b622-5bcc5418ddc9-kube-api-access-9mnt8\") pod \"cert-manager-webhook-6486ffd997-ghxqh\" (UID: \"7512f5d5-26b1-4d49-b622-5bcc5418ddc9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.654423 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.654390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:52.675139 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.675102 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" event={"ID":"488c4952-eef6-4357-ac25-3969be8391b1","Type":"ContainerDied","Data":"00aa8a008ca04307c509f8298117b9c9a0ea7317be800a246b8987d264c899e8"} Sep 16 21:56:52.675286 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.675187 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00aa8a008ca04307c509f8298117b9c9a0ea7317be800a246b8987d264c899e8" Sep 16 21:56:52.675286 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:52.675118 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw55hq" Sep 16 21:56:53.074754 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.074727 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ghxqh"] Sep 16 21:56:53.077154 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:56:53.077128 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7512f5d5_26b1_4d49_b622_5bcc5418ddc9.slice/crio-f8ad7c04cd4259200a6c62997c5274e8fdd828968761e6c1d33cf111c1f43ef3 WatchSource:0}: Error finding container f8ad7c04cd4259200a6c62997c5274e8fdd828968761e6c1d33cf111c1f43ef3: Status 404 returned error can't find the container with id f8ad7c04cd4259200a6c62997c5274e8fdd828968761e6c1d33cf111c1f43ef3 Sep 16 21:56:53.631858 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.631826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:53.681138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.681104 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" event={"ID":"a0daaff3-7e07-4e78-b631-f25664fdb761","Type":"ContainerStarted","Data":"c9c2f1dc42cec50c2e719155ec1bbec14957a337d685b0cd28ffe00d8d0cc63e"} Sep 16 21:56:53.682977 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.682947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" event={"ID":"7512f5d5-26b1-4d49-b622-5bcc5418ddc9","Type":"ContainerStarted","Data":"e5e99b6f73ec223200a086c7f9b5203702cbb22e0cdea0d15cd6360c26871836"} Sep 16 21:56:53.683106 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.682987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" event={"ID":"7512f5d5-26b1-4d49-b622-5bcc5418ddc9","Type":"ContainerStarted","Data":"f8ad7c04cd4259200a6c62997c5274e8fdd828968761e6c1d33cf111c1f43ef3"} Sep 16 21:56:53.683106 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.683041 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:56:53.697846 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.697790 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2974q" podStartSLOduration=1.9901038899999999 podStartE2EDuration="4.697772692s" totalImagesPullingTime="2.707668802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:56:53.695945042 +0000 UTC m=+462.313307900" watchObservedRunningTime="2026-09-16 21:56:53.697772692 +0000 UTC m=+462.315135554" Sep 16 21:56:53.706758 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.706714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:53.717716 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:53.717669 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" podStartSLOduration=1.717653359 podStartE2EDuration="1.717653359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:56:53.715584786 +0000 UTC m=+462.332947646" watchObservedRunningTime="2026-09-16 21:56:53.717653359 +0000 UTC m=+462.335016218" Sep 16 21:56:54.965426 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:54.965394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:59.490663 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:59.490622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:59.586651 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:59.586607 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:56:59.689755 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:56:59.689725 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ghxqh" Sep 16 21:57:01.690954 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.690915 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd"] Sep 16 21:57:01.693629 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.693605 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:01.696250 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.696231 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 16 21:57:01.697386 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.697368 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-llbhn\"" Sep 16 21:57:01.697481 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.697378 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 16 21:57:01.702527 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.702504 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd"] Sep 16 21:57:01.820429 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.820393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbp8c\" (UniqueName: \"kubernetes.io/projected/3b9b76f1-cc41-4b1b-98af-d8d38d02d02e-kube-api-access-xbp8c\") pod \"openshift-lws-operator-fd8ccff4c-pbjtd\" (UID: \"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:01.820582 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.820475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9b76f1-cc41-4b1b-98af-d8d38d02d02e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pbjtd\" (UID: \"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:01.920872 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.920839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9b76f1-cc41-4b1b-98af-d8d38d02d02e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pbjtd\" (UID: \"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:01.921034 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.920945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbp8c\" (UniqueName: \"kubernetes.io/projected/3b9b76f1-cc41-4b1b-98af-d8d38d02d02e-kube-api-access-xbp8c\") pod \"openshift-lws-operator-fd8ccff4c-pbjtd\" (UID: \"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:01.921289 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.921258 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9b76f1-cc41-4b1b-98af-d8d38d02d02e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pbjtd\" (UID: \"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:01.929099 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:01.929080 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbp8c\" (UniqueName: \"kubernetes.io/projected/3b9b76f1-cc41-4b1b-98af-d8d38d02d02e-kube-api-access-xbp8c\") pod \"openshift-lws-operator-fd8ccff4c-pbjtd\" (UID: \"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:02.004220 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:02.004144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" Sep 16 21:57:02.271757 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:02.271730 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd"] Sep 16 21:57:02.273309 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:57:02.273283 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b9b76f1_cc41_4b1b_98af_d8d38d02d02e.slice/crio-79c576feb3fb811cf44fbecd6fcbb1c7b034ac3e54622d04e978356c50cd5f07 WatchSource:0}: Error finding container 79c576feb3fb811cf44fbecd6fcbb1c7b034ac3e54622d04e978356c50cd5f07: Status 404 returned error can't find the container with id 79c576feb3fb811cf44fbecd6fcbb1c7b034ac3e54622d04e978356c50cd5f07 Sep 16 21:57:02.733627 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:02.733587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" event={"ID":"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e","Type":"ContainerStarted","Data":"79c576feb3fb811cf44fbecd6fcbb1c7b034ac3e54622d04e978356c50cd5f07"} Sep 16 21:57:04.746422 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:04.746388 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" event={"ID":"3b9b76f1-cc41-4b1b-98af-d8d38d02d02e","Type":"ContainerStarted","Data":"a46ccb060a5ae284a8739ac4484542f233a4ef5e1240b8344220e3e496b97a09"} Sep 16 21:57:04.762882 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:04.762832 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pbjtd" podStartSLOduration=2.075288353 podStartE2EDuration="3.762817433s" totalImagesPullingTime="1.68752908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:04.760635553 +0000 UTC m=+473.377998417" watchObservedRunningTime="2026-09-16 21:57:04.762817433 +0000 UTC m=+473.380180292" Sep 16 21:57:05.608781 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:05.608750 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:05.676925 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:05.676889 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:07.761342 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:07.761315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:09.079678 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.079637 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8"] Sep 16 21:57:09.082827 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.082803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.085787 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.085763 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 16 21:57:09.085876 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.085832 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m5cww\"" Sep 16 21:57:09.085876 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.085769 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 16 21:57:09.092320 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.092297 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8"] Sep 16 21:57:09.178220 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.178186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.178386 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.178240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfn2c\" (UniqueName: \"kubernetes.io/projected/bb9947d0-1a6b-4858-a27b-b922f95e5723-kube-api-access-wfn2c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.178386 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.178262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.278851 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.278806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.278968 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.278885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfn2c\" (UniqueName: \"kubernetes.io/projected/bb9947d0-1a6b-4858-a27b-b922f95e5723-kube-api-access-wfn2c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.278968 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.278907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.279228 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.279209 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.279310 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.279290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.288741 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.288712 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfn2c\" (UniqueName: \"kubernetes.io/projected/bb9947d0-1a6b-4858-a27b-b922f95e5723-kube-api-access-wfn2c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.392689 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.392658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:09.661938 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.661917 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8"] Sep 16 21:57:09.664034 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:57:09.664005 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9947d0_1a6b_4858_a27b_b922f95e5723.slice/crio-f5309a883e60202cff85495228cc3f18ef9737e7a9079859e4a1664da5c747dc WatchSource:0}: Error finding container f5309a883e60202cff85495228cc3f18ef9737e7a9079859e4a1664da5c747dc: Status 404 returned error can't find the container with id f5309a883e60202cff85495228cc3f18ef9737e7a9079859e4a1664da5c747dc Sep 16 21:57:09.776241 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.776211 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" event={"ID":"bb9947d0-1a6b-4858-a27b-b922f95e5723","Type":"ContainerStarted","Data":"24d76470fa33b001575c2b4d255b86812bd6012ca63568238713f78751cf77f9"} Sep 16 21:57:09.776343 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:09.776285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" event={"ID":"bb9947d0-1a6b-4858-a27b-b922f95e5723","Type":"ContainerStarted","Data":"f5309a883e60202cff85495228cc3f18ef9737e7a9079859e4a1664da5c747dc"} Sep 16 21:57:10.782210 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:10.782180 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerID="24d76470fa33b001575c2b4d255b86812bd6012ca63568238713f78751cf77f9" exitCode=0 Sep 16 21:57:10.782210 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:10.782205 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerID="aee7b113f438aa07db6207f3a4c1eb8c953b79b049fe8ebb94c3af6aa5d4452b" exitCode=0 Sep 16 21:57:10.782605 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:10.782236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" event={"ID":"bb9947d0-1a6b-4858-a27b-b922f95e5723","Type":"ContainerDied","Data":"24d76470fa33b001575c2b4d255b86812bd6012ca63568238713f78751cf77f9"} Sep 16 21:57:10.782605 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:10.782272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" event={"ID":"bb9947d0-1a6b-4858-a27b-b922f95e5723","Type":"ContainerDied","Data":"aee7b113f438aa07db6207f3a4c1eb8c953b79b049fe8ebb94c3af6aa5d4452b"} Sep 16 21:57:11.788517 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:11.788484 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerID="36ecfde55d52a6711c0644d333cd378795c91d2ea54fc79426dada144413e004" exitCode=0 Sep 16 21:57:11.788867 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:11.788558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" event={"ID":"bb9947d0-1a6b-4858-a27b-b922f95e5723","Type":"ContainerDied","Data":"36ecfde55d52a6711c0644d333cd378795c91d2ea54fc79426dada144413e004"} Sep 16 21:57:12.927716 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:12.927692 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:13.007142 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.007114 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-bundle\") pod \"bb9947d0-1a6b-4858-a27b-b922f95e5723\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " Sep 16 21:57:13.007295 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.007163 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfn2c\" (UniqueName: \"kubernetes.io/projected/bb9947d0-1a6b-4858-a27b-b922f95e5723-kube-api-access-wfn2c\") pod \"bb9947d0-1a6b-4858-a27b-b922f95e5723\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " Sep 16 21:57:13.007295 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.007190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-util\") pod \"bb9947d0-1a6b-4858-a27b-b922f95e5723\" (UID: \"bb9947d0-1a6b-4858-a27b-b922f95e5723\") " Sep 16 21:57:13.007932 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.007849 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-bundle" (OuterVolumeSpecName: "bundle") pod "bb9947d0-1a6b-4858-a27b-b922f95e5723" (UID: "bb9947d0-1a6b-4858-a27b-b922f95e5723"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:57:13.009507 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.009477 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb9947d0-1a6b-4858-a27b-b922f95e5723-kube-api-access-wfn2c" (OuterVolumeSpecName: "kube-api-access-wfn2c") pod "bb9947d0-1a6b-4858-a27b-b922f95e5723" (UID: "bb9947d0-1a6b-4858-a27b-b922f95e5723"). InnerVolumeSpecName "kube-api-access-wfn2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:57:13.012984 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.012956 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-util" (OuterVolumeSpecName: "util") pod "bb9947d0-1a6b-4858-a27b-b922f95e5723" (UID: "bb9947d0-1a6b-4858-a27b-b922f95e5723"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:57:13.108345 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.108313 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:57:13.108345 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.108344 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfn2c\" (UniqueName: \"kubernetes.io/projected/bb9947d0-1a6b-4858-a27b-b922f95e5723-kube-api-access-wfn2c\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:57:13.108521 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.108355 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9947d0-1a6b-4858-a27b-b922f95e5723-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:57:13.799859 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.799828 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" Sep 16 21:57:13.799859 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.799847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5zjm8" event={"ID":"bb9947d0-1a6b-4858-a27b-b922f95e5723","Type":"ContainerDied","Data":"f5309a883e60202cff85495228cc3f18ef9737e7a9079859e4a1664da5c747dc"} Sep 16 21:57:13.800083 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:13.799918 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5309a883e60202cff85495228cc3f18ef9737e7a9079859e4a1664da5c747dc" Sep 16 21:57:18.691396 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691350 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z"] Sep 16 21:57:18.691988 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691893 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="pull" Sep 16 21:57:18.691988 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691913 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="pull" Sep 16 21:57:18.691988 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691942 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="util" Sep 16 21:57:18.691988 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691951 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="util" Sep 16 21:57:18.692234 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691989 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="extract" Sep 16 21:57:18.692234 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.691998 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="extract" Sep 16 21:57:18.692234 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.692120 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb9947d0-1a6b-4858-a27b-b922f95e5723" containerName="extract" Sep 16 21:57:18.695286 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.695265 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.697746 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.697723 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 16 21:57:18.697858 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.697838 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m5cww\"" Sep 16 21:57:18.698891 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.698871 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 16 21:57:18.704450 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.704430 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z"] Sep 16 21:57:18.748564 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.748533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.748773 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.748606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.748773 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.748647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4fq\" (UniqueName: \"kubernetes.io/projected/e848fa95-fd25-4a09-9534-07dba31f0728-kube-api-access-9w4fq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.849678 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.849647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.849864 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.849700 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.849864 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.849737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4fq\" (UniqueName: \"kubernetes.io/projected/e848fa95-fd25-4a09-9534-07dba31f0728-kube-api-access-9w4fq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.850088 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.850037 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.850174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.850140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:18.857532 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:18.857506 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4fq\" (UniqueName: \"kubernetes.io/projected/e848fa95-fd25-4a09-9534-07dba31f0728-kube-api-access-9w4fq\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:19.006019 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.005941 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:19.282004 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.281975 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z"] Sep 16 21:57:19.284091 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:57:19.284044 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode848fa95_fd25_4a09_9534_07dba31f0728.slice/crio-f4c821497f3f1c7c1e1532c325140532bf52182b626282c208394b23160a6b3b WatchSource:0}: Error finding container f4c821497f3f1c7c1e1532c325140532bf52182b626282c208394b23160a6b3b: Status 404 returned error can't find the container with id f4c821497f3f1c7c1e1532c325140532bf52182b626282c208394b23160a6b3b Sep 16 21:57:19.783369 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.783327 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:19.830631 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.830595 2575 generic.go:356] "Generic (PLEG): container finished" podID="e848fa95-fd25-4a09-9534-07dba31f0728" containerID="d55e752c042a24bc491b68b923e8839a67ccb0fccd4559a95fa83c3c4429660b" exitCode=0 Sep 16 21:57:19.830786 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.830685 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" event={"ID":"e848fa95-fd25-4a09-9534-07dba31f0728","Type":"ContainerDied","Data":"d55e752c042a24bc491b68b923e8839a67ccb0fccd4559a95fa83c3c4429660b"} Sep 16 21:57:19.830786 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.830731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" event={"ID":"e848fa95-fd25-4a09-9534-07dba31f0728","Type":"ContainerStarted","Data":"f4c821497f3f1c7c1e1532c325140532bf52182b626282c208394b23160a6b3b"} Sep 16 21:57:19.850300 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:19.850277 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:20.433299 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.433268 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:20.654322 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.654291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:20.758625 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.758541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:20.814059 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.811230 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr"] Sep 16 21:57:20.816461 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.816432 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.819464 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.819261 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 16 21:57:20.819464 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.819300 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7ssw8\"" Sep 16 21:57:20.820174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.819858 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 16 21:57:20.820174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.819885 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 16 21:57:20.820174 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.820146 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 16 21:57:20.833638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.833613 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr"] Sep 16 21:57:20.839588 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.839554 2575 generic.go:356] "Generic (PLEG): container finished" podID="e848fa95-fd25-4a09-9534-07dba31f0728" containerID="cbedd23cc5d46a8b38d7af381e6e8ac64a9f8aba7522389c9720824dbd1be30d" exitCode=0 Sep 16 21:57:20.843727 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.843603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" event={"ID":"e848fa95-fd25-4a09-9534-07dba31f0728","Type":"ContainerDied","Data":"cbedd23cc5d46a8b38d7af381e6e8ac64a9f8aba7522389c9720824dbd1be30d"} Sep 16 21:57:20.868326 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.868296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e39c06c9-f132-4bba-984a-4f7bcaab758d-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.868455 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.868344 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e39c06c9-f132-4bba-984a-4f7bcaab758d-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.868523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.868489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e39c06c9-f132-4bba-984a-4f7bcaab758d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.868571 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.868519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e39c06c9-f132-4bba-984a-4f7bcaab758d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.868571 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.868561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl7hv\" (UniqueName: \"kubernetes.io/projected/e39c06c9-f132-4bba-984a-4f7bcaab758d-kube-api-access-fl7hv\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.917489 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.917465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:20.969992 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.969958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e39c06c9-f132-4bba-984a-4f7bcaab758d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.969992 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.969993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e39c06c9-f132-4bba-984a-4f7bcaab758d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.970253 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.970017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl7hv\" (UniqueName: \"kubernetes.io/projected/e39c06c9-f132-4bba-984a-4f7bcaab758d-kube-api-access-fl7hv\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.970253 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.970084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e39c06c9-f132-4bba-984a-4f7bcaab758d-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.970253 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.970123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e39c06c9-f132-4bba-984a-4f7bcaab758d-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.970757 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.970673 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e39c06c9-f132-4bba-984a-4f7bcaab758d-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.972601 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.972572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e39c06c9-f132-4bba-984a-4f7bcaab758d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.972739 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.972616 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e39c06c9-f132-4bba-984a-4f7bcaab758d-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.973059 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.972839 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e39c06c9-f132-4bba-984a-4f7bcaab758d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:20.978867 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:20.978845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl7hv\" (UniqueName: \"kubernetes.io/projected/e39c06c9-f132-4bba-984a-4f7bcaab758d-kube-api-access-fl7hv\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-h5mvr\" (UID: \"e39c06c9-f132-4bba-984a-4f7bcaab758d\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:21.026033 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.026008 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:21.117920 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.117884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:21.129533 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.129513 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:21.218361 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.218332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:21.318908 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.318805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:21.404308 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.404202 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:21.404850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.404831 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr"] Sep 16 21:57:21.407320 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:57:21.407298 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39c06c9_f132_4bba_984a_4f7bcaab758d.slice/crio-66010dcb7b204b3d465ea4ca070483a05e57186b190b8af97de18c6dedba9925 WatchSource:0}: Error finding container 66010dcb7b204b3d465ea4ca070483a05e57186b190b8af97de18c6dedba9925: Status 404 returned error can't find the container with id 66010dcb7b204b3d465ea4ca070483a05e57186b190b8af97de18c6dedba9925 Sep 16 21:57:21.850737 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.850701 2575 generic.go:356] "Generic (PLEG): container finished" podID="e848fa95-fd25-4a09-9534-07dba31f0728" containerID="304e09ad3ab371af28d0a1c0aae93ede41a0e7e7c30e6a06caf1fa2eb6f86ec3" exitCode=0 Sep 16 21:57:21.851217 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.850787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" event={"ID":"e848fa95-fd25-4a09-9534-07dba31f0728","Type":"ContainerDied","Data":"304e09ad3ab371af28d0a1c0aae93ede41a0e7e7c30e6a06caf1fa2eb6f86ec3"} Sep 16 21:57:21.852166 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:21.852145 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" event={"ID":"e39c06c9-f132-4bba-984a-4f7bcaab758d","Type":"ContainerStarted","Data":"66010dcb7b204b3d465ea4ca070483a05e57186b190b8af97de18c6dedba9925"} Sep 16 21:57:24.276389 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.276361 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:24.298267 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.298223 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-bundle\") pod \"e848fa95-fd25-4a09-9534-07dba31f0728\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " Sep 16 21:57:24.298644 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.298300 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w4fq\" (UniqueName: \"kubernetes.io/projected/e848fa95-fd25-4a09-9534-07dba31f0728-kube-api-access-9w4fq\") pod \"e848fa95-fd25-4a09-9534-07dba31f0728\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " Sep 16 21:57:24.298644 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.298366 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-util\") pod \"e848fa95-fd25-4a09-9534-07dba31f0728\" (UID: \"e848fa95-fd25-4a09-9534-07dba31f0728\") " Sep 16 21:57:24.299330 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.299300 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-bundle" (OuterVolumeSpecName: "bundle") pod "e848fa95-fd25-4a09-9534-07dba31f0728" (UID: "e848fa95-fd25-4a09-9534-07dba31f0728"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:57:24.301801 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.301773 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e848fa95-fd25-4a09-9534-07dba31f0728-kube-api-access-9w4fq" (OuterVolumeSpecName: "kube-api-access-9w4fq") pod "e848fa95-fd25-4a09-9534-07dba31f0728" (UID: "e848fa95-fd25-4a09-9534-07dba31f0728"). InnerVolumeSpecName "kube-api-access-9w4fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:57:24.304704 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.304678 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-util" (OuterVolumeSpecName: "util") pod "e848fa95-fd25-4a09-9534-07dba31f0728" (UID: "e848fa95-fd25-4a09-9534-07dba31f0728"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:57:24.399853 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.399825 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:57:24.399853 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.399849 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w4fq\" (UniqueName: \"kubernetes.io/projected/e848fa95-fd25-4a09-9534-07dba31f0728-kube-api-access-9w4fq\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:57:24.399998 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.399860 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e848fa95-fd25-4a09-9534-07dba31f0728-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:57:24.875850 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.875825 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" Sep 16 21:57:24.876023 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.875855 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rr42z" event={"ID":"e848fa95-fd25-4a09-9534-07dba31f0728","Type":"ContainerDied","Data":"f4c821497f3f1c7c1e1532c325140532bf52182b626282c208394b23160a6b3b"} Sep 16 21:57:24.876023 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.875901 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4c821497f3f1c7c1e1532c325140532bf52182b626282c208394b23160a6b3b" Sep 16 21:57:24.877702 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:24.877672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" event={"ID":"e39c06c9-f132-4bba-984a-4f7bcaab758d","Type":"ContainerStarted","Data":"a85b6268649889dcab05154806f4ff8fbf1d0b1de6b9068c333e3576f11fddf5"} Sep 16 21:57:25.884478 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:25.884449 2575 generic.go:356] "Generic (PLEG): container finished" podID="e39c06c9-f132-4bba-984a-4f7bcaab758d" containerID="a85b6268649889dcab05154806f4ff8fbf1d0b1de6b9068c333e3576f11fddf5" exitCode=0 Sep 16 21:57:25.885376 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:25.885349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" event={"ID":"e39c06c9-f132-4bba-984a-4f7bcaab758d","Type":"ContainerDied","Data":"a85b6268649889dcab05154806f4ff8fbf1d0b1de6b9068c333e3576f11fddf5"} Sep 16 21:57:26.891134 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:26.891101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" event={"ID":"e39c06c9-f132-4bba-984a-4f7bcaab758d","Type":"ContainerStarted","Data":"b61b9cd393efceeda53914742d0da1a10a0d1619e7f3d0ea47941428cf67768c"} Sep 16 21:57:26.891544 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:26.891203 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:26.919975 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:26.919914 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" podStartSLOduration=2.582255822 podStartE2EDuration="6.919890442s" totalImagesPullingTime="3.334253478s" totalInitContainerRuntime="1.003381142s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:26.91788821 +0000 UTC m=+495.535251104" watchObservedRunningTime="2026-09-16 21:57:26.919890442 +0000 UTC m=+495.537253301" Sep 16 21:57:31.424245 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:31.424211 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:31.524219 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:31.524189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:34.758269 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:34.758231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:34.858286 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:34.858255 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:37.903736 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:37.903708 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-h5mvr" Sep 16 21:57:39.549999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:39.549972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:39.645578 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:39.645548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:50.092043 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:50.092006 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:50.363521 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:50.363491 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:50.526780 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:50.526748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:50.613258 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:50.613225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:50.713591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:50.713518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:50.819901 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:50.819866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:51.207939 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.207910 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r59nr"] Sep 16 21:57:51.208320 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208306 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="pull" Sep 16 21:57:51.208362 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208322 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="pull" Sep 16 21:57:51.208362 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208338 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="util" Sep 16 21:57:51.208362 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208343 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="util" Sep 16 21:57:51.208362 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208351 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="extract" Sep 16 21:57:51.208362 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208356 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="extract" Sep 16 21:57:51.208530 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.208418 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e848fa95-fd25-4a09-9534-07dba31f0728" containerName="extract" Sep 16 21:57:51.211527 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.211509 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.214030 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.214011 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 16 21:57:51.220342 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.220318 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r59nr"] Sep 16 21:57:51.221659 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.221627 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:51.329942 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.329898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-tls-certs\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.329942 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.329947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9n7h\" (UniqueName: \"kubernetes.io/projected/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-kube-api-access-x9n7h\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.368638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.368604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:51.430624 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.430588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-tls-certs\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.430779 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.430636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9n7h\" (UniqueName: \"kubernetes.io/projected/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-kube-api-access-x9n7h\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.430779 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:57:51.430752 2575 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 16 21:57:51.430871 ip-10-0-142-168 kubenswrapper[2575]: E0916 21:57:51.430820 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-tls-certs podName:fd74dc6f-f4a9-421c-bb7b-61f29b2d0023 nodeName:}" failed. No retries permitted until 2026-09-16 21:57:51.930799606 +0000 UTC m=+520.548162455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-tls-certs") pod "model-serving-api-54d89bd5fc-r59nr" (UID: "fd74dc6f-f4a9-421c-bb7b-61f29b2d0023") : secret "model-serving-api-tls" not found Sep 16 21:57:51.448910 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.448874 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9n7h\" (UniqueName: \"kubernetes.io/projected/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-kube-api-access-x9n7h\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.476283 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.476194 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:51.859374 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.859332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:51.935591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.935564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-tls-certs\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:51.938395 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:51.938372 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd74dc6f-f4a9-421c-bb7b-61f29b2d0023-tls-certs\") pod \"model-serving-api-54d89bd5fc-r59nr\" (UID: \"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023\") " pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:52.123314 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:52.123231 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:52.250268 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:52.250233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:52.392817 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:52.392745 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r59nr"] Sep 16 21:57:52.395938 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:57:52.395907 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd74dc6f_f4a9_421c_bb7b_61f29b2d0023.slice/crio-c5c3b44c771f1dd4dd8611d134367523af3a81c2527cdfd84a866ef20a1c48e7 WatchSource:0}: Error finding container c5c3b44c771f1dd4dd8611d134367523af3a81c2527cdfd84a866ef20a1c48e7: Status 404 returned error can't find the container with id c5c3b44c771f1dd4dd8611d134367523af3a81c2527cdfd84a866ef20a1c48e7 Sep 16 21:57:53.031643 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:53.031605 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" event={"ID":"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023","Type":"ContainerStarted","Data":"c5c3b44c771f1dd4dd8611d134367523af3a81c2527cdfd84a866ef20a1c48e7"} Sep 16 21:57:55.044438 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:55.044402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" event={"ID":"fd74dc6f-f4a9-421c-bb7b-61f29b2d0023","Type":"ContainerStarted","Data":"268c6f63978cfc5c8845066276ac8a87ccd35f70ba895efd01392c6d0132fb78"} Sep 16 21:57:55.044881 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:55.044518 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:57:55.059628 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:55.059557 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" podStartSLOduration=1.5530713569999999 podStartE2EDuration="4.059536805s" totalImagesPullingTime="2.506465448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:55.058464551 +0000 UTC m=+523.675827411" watchObservedRunningTime="2026-09-16 21:57:55.059536805 +0000 UTC m=+523.676899667" Sep 16 21:57:55.245758 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:55.245663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:57:58.168611 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.168580 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx"] Sep 16 21:57:58.176800 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.176780 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.182294 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.182271 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 16 21:57:58.182294 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.182287 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 16 21:57:58.182485 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.182335 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wkbv6\"" Sep 16 21:57:58.182485 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.182350 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 16 21:57:58.183229 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.183212 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 16 21:57:58.183496 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.183480 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 16 21:57:58.183745 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.183731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 16 21:57:58.203894 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.203861 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx"] Sep 16 21:57:58.294243 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.294420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/698de614-4e03-46ca-b9a5-2169874c71f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.294420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.294420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j92v\" (UniqueName: \"kubernetes.io/projected/698de614-4e03-46ca-b9a5-2169874c71f5-kube-api-access-7j92v\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.294420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de614-4e03-46ca-b9a5-2169874c71f5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.294420 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.294624 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.294478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de614-4e03-46ca-b9a5-2169874c71f5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395317 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/698de614-4e03-46ca-b9a5-2169874c71f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j92v\" (UniqueName: \"kubernetes.io/projected/698de614-4e03-46ca-b9a5-2169874c71f5-kube-api-access-7j92v\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de614-4e03-46ca-b9a5-2169874c71f5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395504 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395675 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de614-4e03-46ca-b9a5-2169874c71f5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395675 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.395946 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.395913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/698de614-4e03-46ca-b9a5-2169874c71f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.397993 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.397963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.398118 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.397994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de614-4e03-46ca-b9a5-2169874c71f5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.398118 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.398053 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.398374 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.398357 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/698de614-4e03-46ca-b9a5-2169874c71f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.410894 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.410870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de614-4e03-46ca-b9a5-2169874c71f5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.410894 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.410893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j92v\" (UniqueName: \"kubernetes.io/projected/698de614-4e03-46ca-b9a5-2169874c71f5-kube-api-access-7j92v\") pod \"istiod-openshift-gateway-5677ccb49b-ft5fx\" (UID: \"698de614-4e03-46ca-b9a5-2169874c71f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.486137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.486029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:57:58.764748 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:58.764722 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx"] Sep 16 21:57:58.766116 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:57:58.766094 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698de614_4e03_46ca_b9a5_2169874c71f5.slice/crio-8a8a361674d92a87f713887b6a5e01fa06f021c816d473c8c7c67ffcb61baa82 WatchSource:0}: Error finding container 8a8a361674d92a87f713887b6a5e01fa06f021c816d473c8c7c67ffcb61baa82: Status 404 returned error can't find the container with id 8a8a361674d92a87f713887b6a5e01fa06f021c816d473c8c7c67ffcb61baa82 Sep 16 21:57:59.070114 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.069999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" event={"ID":"698de614-4e03-46ca-b9a5-2169874c71f5","Type":"ContainerStarted","Data":"8a8a361674d92a87f713887b6a5e01fa06f021c816d473c8c7c67ffcb61baa82"} Sep 16 21:57:59.500928 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.500891 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p"] Sep 16 21:57:59.503559 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.503543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.507232 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.507164 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 16 21:57:59.507919 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.507671 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 16 21:57:59.507919 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.507742 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 16 21:57:59.507919 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.507836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dbs2l\"" Sep 16 21:57:59.514262 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.514231 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p"] Sep 16 21:57:59.605809 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.605771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbq5\" (UniqueName: \"kubernetes.io/projected/aa9b1ae0-ff65-4e70-95c3-faca3175f468-kube-api-access-fwbq5\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.605989 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.605879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa9b1ae0-ff65-4e70-95c3-faca3175f468-cert\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.605989 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.605919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa9b1ae0-ff65-4e70-95c3-faca3175f468-manager-config\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.606158 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.606041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa9b1ae0-ff65-4e70-95c3-faca3175f468-metrics-cert\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.706862 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.706828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbq5\" (UniqueName: \"kubernetes.io/projected/aa9b1ae0-ff65-4e70-95c3-faca3175f468-kube-api-access-fwbq5\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.707023 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.706886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa9b1ae0-ff65-4e70-95c3-faca3175f468-cert\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.707023 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.706918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa9b1ae0-ff65-4e70-95c3-faca3175f468-manager-config\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.707023 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.706998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa9b1ae0-ff65-4e70-95c3-faca3175f468-metrics-cert\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.707525 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.707503 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa9b1ae0-ff65-4e70-95c3-faca3175f468-manager-config\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.709586 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.709563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa9b1ae0-ff65-4e70-95c3-faca3175f468-metrics-cert\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.709687 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.709568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa9b1ae0-ff65-4e70-95c3-faca3175f468-cert\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.715670 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.715650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbq5\" (UniqueName: \"kubernetes.io/projected/aa9b1ae0-ff65-4e70-95c3-faca3175f468-kube-api-access-fwbq5\") pod \"lws-controller-manager-68dbcd7456-gv24p\" (UID: \"aa9b1ae0-ff65-4e70-95c3-faca3175f468\") " pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.818523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.818401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:57:59.922697 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:57:59.922621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:00.028032 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:00.027901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:00.105558 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:00.105533 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p"] Sep 16 21:58:00.106700 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:58:00.106671 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9b1ae0_ff65_4e70_95c3_faca3175f468.slice/crio-ffe850f6c544c65440aa4606b8c5309027c1023aecf0345cd0dbf0b476654584 WatchSource:0}: Error finding container ffe850f6c544c65440aa4606b8c5309027c1023aecf0345cd0dbf0b476654584: Status 404 returned error can't find the container with id ffe850f6c544c65440aa4606b8c5309027c1023aecf0345cd0dbf0b476654584 Sep 16 21:58:00.684621 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:00.684585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:01.085454 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.085362 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" event={"ID":"aa9b1ae0-ff65-4e70-95c3-faca3175f468","Type":"ContainerStarted","Data":"ffe850f6c544c65440aa4606b8c5309027c1023aecf0345cd0dbf0b476654584"} Sep 16 21:58:01.086321 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.086280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:01.179139 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.179036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:01.282221 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.282152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:01.402272 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.402203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:01.502310 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.502239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:01.680629 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:01.680538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:02.237505 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:02.237467 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 16 21:58:02.237798 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:02.237548 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 16 21:58:02.268384 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:02.268342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:02.581523 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:02.581440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:02.680834 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:02.680756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:02.741399 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:02.741366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:03.101157 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:03.101112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" event={"ID":"698de614-4e03-46ca-b9a5-2169874c71f5","Type":"ContainerStarted","Data":"a0a9f78b1fa4867e78702ba10463cc2268f8bd91e3339a9412b1090a9b1cc2e5"} Sep 16 21:58:03.101752 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:03.101726 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:58:03.103025 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:03.102993 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-ft5fx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 16 21:58:03.103176 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:03.103044 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" podUID="698de614-4e03-46ca-b9a5-2169874c71f5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 21:58:03.131686 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:03.131479 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" podStartSLOduration=1.662412105 podStartE2EDuration="5.131443745s" totalImagesPullingTime="3.46903164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:58:03.122193786 +0000 UTC m=+531.739556647" watchObservedRunningTime="2026-09-16 21:58:03.131443745 +0000 UTC m=+531.748806609" Sep 16 21:58:04.108438 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:04.108400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" event={"ID":"aa9b1ae0-ff65-4e70-95c3-faca3175f468","Type":"ContainerStarted","Data":"27e0a2cce7e1e0bd8a459f341a16dc3b7fedad67a1598149015ee4b7d0361eef"} Sep 16 21:58:04.108837 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:04.108555 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:58:04.109160 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:04.109139 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-ft5fx" Sep 16 21:58:04.128758 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:04.128708 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" podStartSLOduration=1.9105952080000002 podStartE2EDuration="5.128687939s" totalImagesPullingTime="3.218092731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:58:04.125734591 +0000 UTC m=+532.743097452" watchObservedRunningTime="2026-09-16 21:58:04.128687939 +0000 UTC m=+532.746050797" Sep 16 21:58:06.053545 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:06.053517 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-r59nr" Sep 16 21:58:15.115696 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:15.115664 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68dbcd7456-gv24p" Sep 16 21:58:51.616130 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:51.616089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:58:52.607221 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:58:52.607193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:02.372279 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:02.372247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:06.423984 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.423945 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5"] Sep 16 21:59:06.427352 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.427331 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.429801 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.429779 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 16 21:59:06.429801 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.429800 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 16 21:59:06.429993 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.429881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m5cww\"" Sep 16 21:59:06.436859 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.436829 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5"] Sep 16 21:59:06.500668 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.500635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.500668 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.500667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.500905 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.500785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9lfl\" (UniqueName: \"kubernetes.io/projected/794984aa-c5db-40d4-b2d5-34d3af5cf707-kube-api-access-p9lfl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.519731 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.519695 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss"] Sep 16 21:59:06.522795 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.522776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.530947 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.530911 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss"] Sep 16 21:59:06.601481 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9lfl\" (UniqueName: \"kubernetes.io/projected/794984aa-c5db-40d4-b2d5-34d3af5cf707-kube-api-access-p9lfl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.601669 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.601669 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.601669 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601585 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.601669 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.601669 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2m9r\" (UniqueName: \"kubernetes.io/projected/734906de-b214-4bdf-9fe6-2dec8b04e0da-kube-api-access-l2m9r\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.601936 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601917 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.601971 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.601948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.610344 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.610311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9lfl\" (UniqueName: \"kubernetes.io/projected/794984aa-c5db-40d4-b2d5-34d3af5cf707-kube-api-access-p9lfl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.622480 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.622455 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9"] Sep 16 21:59:06.625240 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.625224 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.633638 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.633617 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9"] Sep 16 21:59:06.703140 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.703276 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.703276 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.703276 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.703276 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2m9r\" (UniqueName: \"kubernetes.io/projected/734906de-b214-4bdf-9fe6-2dec8b04e0da-kube-api-access-l2m9r\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.703689 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zlw\" (UniqueName: \"kubernetes.io/projected/1069b9ec-082a-4f46-9aa4-4230f1251e0d-kube-api-access-58zlw\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.703689 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703588 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.703689 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.703605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.713718 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.713693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2m9r\" (UniqueName: \"kubernetes.io/projected/734906de-b214-4bdf-9fe6-2dec8b04e0da-kube-api-access-l2m9r\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.720793 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.720760 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8"] Sep 16 21:59:06.723511 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.723496 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.732133 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.732113 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8"] Sep 16 21:59:06.743145 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.743124 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:06.804748 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.804705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.804895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.804766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.804895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.804796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58zlw\" (UniqueName: \"kubernetes.io/projected/1069b9ec-082a-4f46-9aa4-4230f1251e0d-kube-api-access-58zlw\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.804895 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.804824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.805128 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.804902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.805128 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.804971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gx8z\" (UniqueName: \"kubernetes.io/projected/6b100636-8d72-41cb-9683-1102fb6817a3-kube-api-access-2gx8z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.805751 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.805687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.805871 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.805783 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.815643 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.815597 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zlw\" (UniqueName: \"kubernetes.io/projected/1069b9ec-082a-4f46-9aa4-4230f1251e0d-kube-api-access-58zlw\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:06.832479 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.832451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:06.905695 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.905660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gx8z\" (UniqueName: \"kubernetes.io/projected/6b100636-8d72-41cb-9683-1102fb6817a3-kube-api-access-2gx8z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.905882 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.905757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.905882 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.905787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.906268 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.906244 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.906268 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.906262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.914824 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.914798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gx8z\" (UniqueName: \"kubernetes.io/projected/6b100636-8d72-41cb-9683-1102fb6817a3-kube-api-access-2gx8z\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:06.936213 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:06.936189 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:07.015615 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.015584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5"] Sep 16 21:59:07.018820 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:59:07.018788 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794984aa_c5db_40d4_b2d5_34d3af5cf707.slice/crio-57ede63daea178084d1b35d2d23f9edf1d9705cd7733c0cad848942558feeb68 WatchSource:0}: Error finding container 57ede63daea178084d1b35d2d23f9edf1d9705cd7733c0cad848942558feeb68: Status 404 returned error can't find the container with id 57ede63daea178084d1b35d2d23f9edf1d9705cd7733c0cad848942558feeb68 Sep 16 21:59:07.034399 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.034380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:07.101999 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.101969 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss"] Sep 16 21:59:07.103492 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:59:07.103441 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734906de_b214_4bdf_9fe6_2dec8b04e0da.slice/crio-0f1837247e99667332982f9f21ae34e093b65b2d091c083daf941fef3cf0fddf WatchSource:0}: Error finding container 0f1837247e99667332982f9f21ae34e093b65b2d091c083daf941fef3cf0fddf: Status 404 returned error can't find the container with id 0f1837247e99667332982f9f21ae34e093b65b2d091c083daf941fef3cf0fddf Sep 16 21:59:07.207991 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:59:07.207968 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1069b9ec_082a_4f46_9aa4_4230f1251e0d.slice/crio-664b92ce148228d86732896bcfd4425fb883bd1a541062e8611ae4d39b29bf56 WatchSource:0}: Error finding container 664b92ce148228d86732896bcfd4425fb883bd1a541062e8611ae4d39b29bf56: Status 404 returned error can't find the container with id 664b92ce148228d86732896bcfd4425fb883bd1a541062e8611ae4d39b29bf56 Sep 16 21:59:07.208262 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.208241 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9"] Sep 16 21:59:07.306227 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.306196 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8"] Sep 16 21:59:07.367832 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:59:07.367801 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b100636_8d72_41cb_9683_1102fb6817a3.slice/crio-818c68d808a79654503bbef9ee465f8398a91da40740c8db9ea803d2e99ed698 WatchSource:0}: Error finding container 818c68d808a79654503bbef9ee465f8398a91da40740c8db9ea803d2e99ed698: Status 404 returned error can't find the container with id 818c68d808a79654503bbef9ee465f8398a91da40740c8db9ea803d2e99ed698 Sep 16 21:59:07.437089 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.437036 2575 generic.go:356] "Generic (PLEG): container finished" podID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerID="7c0c06b69d70ebb90f24b70215771f3ed7ca8b51ea2531d81d7009295b02f116" exitCode=0 Sep 16 21:59:07.437550 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.437110 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" event={"ID":"794984aa-c5db-40d4-b2d5-34d3af5cf707","Type":"ContainerDied","Data":"7c0c06b69d70ebb90f24b70215771f3ed7ca8b51ea2531d81d7009295b02f116"} Sep 16 21:59:07.437550 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.437171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" event={"ID":"794984aa-c5db-40d4-b2d5-34d3af5cf707","Type":"ContainerStarted","Data":"57ede63daea178084d1b35d2d23f9edf1d9705cd7733c0cad848942558feeb68"} Sep 16 21:59:07.439037 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.438888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" event={"ID":"6b100636-8d72-41cb-9683-1102fb6817a3","Type":"ContainerStarted","Data":"8173dea719266985e6c52aea5e0f3b39d81bd8dc885e6e920c4491ce294a5606"} Sep 16 21:59:07.439037 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.438943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" event={"ID":"6b100636-8d72-41cb-9683-1102fb6817a3","Type":"ContainerStarted","Data":"818c68d808a79654503bbef9ee465f8398a91da40740c8db9ea803d2e99ed698"} Sep 16 21:59:07.440765 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.440744 2575 generic.go:356] "Generic (PLEG): container finished" podID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerID="8948ed3f8cab7abbd0a854799ed92aa6663b030a59daccb819b3c6ec72908ecf" exitCode=0 Sep 16 21:59:07.440873 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.440826 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" event={"ID":"734906de-b214-4bdf-9fe6-2dec8b04e0da","Type":"ContainerDied","Data":"8948ed3f8cab7abbd0a854799ed92aa6663b030a59daccb819b3c6ec72908ecf"} Sep 16 21:59:07.440873 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.440868 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" event={"ID":"734906de-b214-4bdf-9fe6-2dec8b04e0da","Type":"ContainerStarted","Data":"0f1837247e99667332982f9f21ae34e093b65b2d091c083daf941fef3cf0fddf"} Sep 16 21:59:07.442659 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.442639 2575 generic.go:356] "Generic (PLEG): container finished" podID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerID="f7a51e26dadc51af482a351d1bd6d6b94b9c85bb492648d7665e56dd8faea9cb" exitCode=0 Sep 16 21:59:07.442750 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.442672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" event={"ID":"1069b9ec-082a-4f46-9aa4-4230f1251e0d","Type":"ContainerDied","Data":"f7a51e26dadc51af482a351d1bd6d6b94b9c85bb492648d7665e56dd8faea9cb"} Sep 16 21:59:07.442750 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:07.442705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" event={"ID":"1069b9ec-082a-4f46-9aa4-4230f1251e0d","Type":"ContainerStarted","Data":"664b92ce148228d86732896bcfd4425fb883bd1a541062e8611ae4d39b29bf56"} Sep 16 21:59:08.449348 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:08.449313 2575 generic.go:356] "Generic (PLEG): container finished" podID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerID="ad38867d5861ad259889b3309c3f17f043481414a1b6c669a223f2bc120fd2c2" exitCode=0 Sep 16 21:59:08.449735 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:08.449363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" event={"ID":"794984aa-c5db-40d4-b2d5-34d3af5cf707","Type":"ContainerDied","Data":"ad38867d5861ad259889b3309c3f17f043481414a1b6c669a223f2bc120fd2c2"} Sep 16 21:59:08.451052 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:08.451034 2575 generic.go:356] "Generic (PLEG): container finished" podID="6b100636-8d72-41cb-9683-1102fb6817a3" containerID="8173dea719266985e6c52aea5e0f3b39d81bd8dc885e6e920c4491ce294a5606" exitCode=0 Sep 16 21:59:08.451154 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:08.451103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" event={"ID":"6b100636-8d72-41cb-9683-1102fb6817a3","Type":"ContainerDied","Data":"8173dea719266985e6c52aea5e0f3b39d81bd8dc885e6e920c4491ce294a5606"} Sep 16 21:59:09.458225 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:09.458194 2575 generic.go:356] "Generic (PLEG): container finished" podID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerID="fb7e4d74ff2d60a656fa94f369ed46a10f36a049bf647e47383cce6380b0aafa" exitCode=0 Sep 16 21:59:09.458586 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:09.458284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" event={"ID":"1069b9ec-082a-4f46-9aa4-4230f1251e0d","Type":"ContainerDied","Data":"fb7e4d74ff2d60a656fa94f369ed46a10f36a049bf647e47383cce6380b0aafa"} Sep 16 21:59:09.460709 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:09.460683 2575 generic.go:356] "Generic (PLEG): container finished" podID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerID="bd66534e00f6855223a73082f8e91255552fa52a55ff886826403f5c2ce45d9d" exitCode=0 Sep 16 21:59:09.460814 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:09.460772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" event={"ID":"794984aa-c5db-40d4-b2d5-34d3af5cf707","Type":"ContainerDied","Data":"bd66534e00f6855223a73082f8e91255552fa52a55ff886826403f5c2ce45d9d"} Sep 16 21:59:10.468437 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.468407 2575 generic.go:356] "Generic (PLEG): container finished" podID="6b100636-8d72-41cb-9683-1102fb6817a3" containerID="16c5420b6e379b4b3d9d109240f39d1c63b86a8bfe91cf8d379dbe40a37547cc" exitCode=0 Sep 16 21:59:10.468835 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.468493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" event={"ID":"6b100636-8d72-41cb-9683-1102fb6817a3","Type":"ContainerDied","Data":"16c5420b6e379b4b3d9d109240f39d1c63b86a8bfe91cf8d379dbe40a37547cc"} Sep 16 21:59:10.470816 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.470797 2575 generic.go:356] "Generic (PLEG): container finished" podID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerID="d4d2bd1b17332fa181d07d15f0768f3e5ae9a58722f5b9db484825254b02c8fa" exitCode=0 Sep 16 21:59:10.470919 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.470856 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" event={"ID":"1069b9ec-082a-4f46-9aa4-4230f1251e0d","Type":"ContainerDied","Data":"d4d2bd1b17332fa181d07d15f0768f3e5ae9a58722f5b9db484825254b02c8fa"} Sep 16 21:59:10.675871 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.675848 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:10.742437 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.742359 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-bundle\") pod \"794984aa-c5db-40d4-b2d5-34d3af5cf707\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " Sep 16 21:59:10.742437 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.742390 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-util\") pod \"794984aa-c5db-40d4-b2d5-34d3af5cf707\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " Sep 16 21:59:10.742604 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.742475 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9lfl\" (UniqueName: \"kubernetes.io/projected/794984aa-c5db-40d4-b2d5-34d3af5cf707-kube-api-access-p9lfl\") pod \"794984aa-c5db-40d4-b2d5-34d3af5cf707\" (UID: \"794984aa-c5db-40d4-b2d5-34d3af5cf707\") " Sep 16 21:59:10.742800 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.742777 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-bundle" (OuterVolumeSpecName: "bundle") pod "794984aa-c5db-40d4-b2d5-34d3af5cf707" (UID: "794984aa-c5db-40d4-b2d5-34d3af5cf707"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:10.744691 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.744660 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794984aa-c5db-40d4-b2d5-34d3af5cf707-kube-api-access-p9lfl" (OuterVolumeSpecName: "kube-api-access-p9lfl") pod "794984aa-c5db-40d4-b2d5-34d3af5cf707" (UID: "794984aa-c5db-40d4-b2d5-34d3af5cf707"). InnerVolumeSpecName "kube-api-access-p9lfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:59:10.747482 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.747453 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-util" (OuterVolumeSpecName: "util") pod "794984aa-c5db-40d4-b2d5-34d3af5cf707" (UID: "794984aa-c5db-40d4-b2d5-34d3af5cf707"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:10.843363 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.843316 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:10.843363 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.843356 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/794984aa-c5db-40d4-b2d5-34d3af5cf707-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:10.843363 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:10.843369 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9lfl\" (UniqueName: \"kubernetes.io/projected/794984aa-c5db-40d4-b2d5-34d3af5cf707-kube-api-access-p9lfl\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:11.477615 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.477583 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" Sep 16 21:59:11.478046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.477615 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gdth5" event={"ID":"794984aa-c5db-40d4-b2d5-34d3af5cf707","Type":"ContainerDied","Data":"57ede63daea178084d1b35d2d23f9edf1d9705cd7733c0cad848942558feeb68"} Sep 16 21:59:11.478046 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.477659 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57ede63daea178084d1b35d2d23f9edf1d9705cd7733c0cad848942558feeb68" Sep 16 21:59:11.479776 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.479753 2575 generic.go:356] "Generic (PLEG): container finished" podID="6b100636-8d72-41cb-9683-1102fb6817a3" containerID="b900f9578fa9776a3b94548a5063f632c4896a3e43466170f81613ea67d1f66a" exitCode=0 Sep 16 21:59:11.479874 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.479820 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" event={"ID":"6b100636-8d72-41cb-9683-1102fb6817a3","Type":"ContainerDied","Data":"b900f9578fa9776a3b94548a5063f632c4896a3e43466170f81613ea67d1f66a"} Sep 16 21:59:11.608868 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.608845 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:11.649956 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.649924 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58zlw\" (UniqueName: \"kubernetes.io/projected/1069b9ec-082a-4f46-9aa4-4230f1251e0d-kube-api-access-58zlw\") pod \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " Sep 16 21:59:11.650128 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.650003 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-util\") pod \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " Sep 16 21:59:11.650128 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.650058 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-bundle\") pod \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\" (UID: \"1069b9ec-082a-4f46-9aa4-4230f1251e0d\") " Sep 16 21:59:11.650601 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.650574 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-bundle" (OuterVolumeSpecName: "bundle") pod "1069b9ec-082a-4f46-9aa4-4230f1251e0d" (UID: "1069b9ec-082a-4f46-9aa4-4230f1251e0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:11.652326 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.652305 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1069b9ec-082a-4f46-9aa4-4230f1251e0d-kube-api-access-58zlw" (OuterVolumeSpecName: "kube-api-access-58zlw") pod "1069b9ec-082a-4f46-9aa4-4230f1251e0d" (UID: "1069b9ec-082a-4f46-9aa4-4230f1251e0d"). InnerVolumeSpecName "kube-api-access-58zlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:59:11.655600 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.655566 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-util" (OuterVolumeSpecName: "util") pod "1069b9ec-082a-4f46-9aa4-4230f1251e0d" (UID: "1069b9ec-082a-4f46-9aa4-4230f1251e0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:11.750734 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.750665 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58zlw\" (UniqueName: \"kubernetes.io/projected/1069b9ec-082a-4f46-9aa4-4230f1251e0d-kube-api-access-58zlw\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:11.750734 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.750688 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:11.750734 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:11.750697 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1069b9ec-082a-4f46-9aa4-4230f1251e0d-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:12.489283 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.488544 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" event={"ID":"1069b9ec-082a-4f46-9aa4-4230f1251e0d","Type":"ContainerDied","Data":"664b92ce148228d86732896bcfd4425fb883bd1a541062e8611ae4d39b29bf56"} Sep 16 21:59:12.489283 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.488596 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664b92ce148228d86732896bcfd4425fb883bd1a541062e8611ae4d39b29bf56" Sep 16 21:59:12.489283 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.488685 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg2vd9" Sep 16 21:59:12.661810 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.661786 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:12.758890 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.758802 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-bundle\") pod \"6b100636-8d72-41cb-9683-1102fb6817a3\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " Sep 16 21:59:12.758890 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.758841 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gx8z\" (UniqueName: \"kubernetes.io/projected/6b100636-8d72-41cb-9683-1102fb6817a3-kube-api-access-2gx8z\") pod \"6b100636-8d72-41cb-9683-1102fb6817a3\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " Sep 16 21:59:12.758890 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.758856 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-util\") pod \"6b100636-8d72-41cb-9683-1102fb6817a3\" (UID: \"6b100636-8d72-41cb-9683-1102fb6817a3\") " Sep 16 21:59:12.759358 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.759334 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-bundle" (OuterVolumeSpecName: "bundle") pod "6b100636-8d72-41cb-9683-1102fb6817a3" (UID: "6b100636-8d72-41cb-9683-1102fb6817a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:12.761158 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.761126 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b100636-8d72-41cb-9683-1102fb6817a3-kube-api-access-2gx8z" (OuterVolumeSpecName: "kube-api-access-2gx8z") pod "6b100636-8d72-41cb-9683-1102fb6817a3" (UID: "6b100636-8d72-41cb-9683-1102fb6817a3"). InnerVolumeSpecName "kube-api-access-2gx8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:59:12.764430 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.764408 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-util" (OuterVolumeSpecName: "util") pod "6b100636-8d72-41cb-9683-1102fb6817a3" (UID: "6b100636-8d72-41cb-9683-1102fb6817a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:12.860275 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.860241 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:12.860275 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.860271 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gx8z\" (UniqueName: \"kubernetes.io/projected/6b100636-8d72-41cb-9683-1102fb6817a3-kube-api-access-2gx8z\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:12.860275 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:12.860281 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b100636-8d72-41cb-9683-1102fb6817a3-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:13.495990 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:13.495963 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" Sep 16 21:59:13.496443 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:13.495957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c69vcq8" event={"ID":"6b100636-8d72-41cb-9683-1102fb6817a3","Type":"ContainerDied","Data":"818c68d808a79654503bbef9ee465f8398a91da40740c8db9ea803d2e99ed698"} Sep 16 21:59:13.496443 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:13.496098 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="818c68d808a79654503bbef9ee465f8398a91da40740c8db9ea803d2e99ed698" Sep 16 21:59:13.497973 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:13.497947 2575 generic.go:356] "Generic (PLEG): container finished" podID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerID="1b054950c38c801928215d65749751616c757b6cd20d7897672004700ed70aed" exitCode=0 Sep 16 21:59:13.498126 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:13.498017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" event={"ID":"734906de-b214-4bdf-9fe6-2dec8b04e0da","Type":"ContainerDied","Data":"1b054950c38c801928215d65749751616c757b6cd20d7897672004700ed70aed"} Sep 16 21:59:14.506047 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:14.506012 2575 generic.go:356] "Generic (PLEG): container finished" podID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerID="f58b4025006908381028cb1d268daa22c57fb4f4208b220ef07688de2bdcf1ca" exitCode=0 Sep 16 21:59:14.506515 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:14.506103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" event={"ID":"734906de-b214-4bdf-9fe6-2dec8b04e0da","Type":"ContainerDied","Data":"f58b4025006908381028cb1d268daa22c57fb4f4208b220ef07688de2bdcf1ca"} Sep 16 21:59:15.640945 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.640924 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:15.687152 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.687119 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2m9r\" (UniqueName: \"kubernetes.io/projected/734906de-b214-4bdf-9fe6-2dec8b04e0da-kube-api-access-l2m9r\") pod \"734906de-b214-4bdf-9fe6-2dec8b04e0da\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " Sep 16 21:59:15.687307 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.687176 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-util\") pod \"734906de-b214-4bdf-9fe6-2dec8b04e0da\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " Sep 16 21:59:15.687307 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.687257 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-bundle\") pod \"734906de-b214-4bdf-9fe6-2dec8b04e0da\" (UID: \"734906de-b214-4bdf-9fe6-2dec8b04e0da\") " Sep 16 21:59:15.687830 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.687803 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-bundle" (OuterVolumeSpecName: "bundle") pod "734906de-b214-4bdf-9fe6-2dec8b04e0da" (UID: "734906de-b214-4bdf-9fe6-2dec8b04e0da"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:15.689335 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.689310 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734906de-b214-4bdf-9fe6-2dec8b04e0da-kube-api-access-l2m9r" (OuterVolumeSpecName: "kube-api-access-l2m9r") pod "734906de-b214-4bdf-9fe6-2dec8b04e0da" (UID: "734906de-b214-4bdf-9fe6-2dec8b04e0da"). InnerVolumeSpecName "kube-api-access-l2m9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 21:59:15.691726 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.691700 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-util" (OuterVolumeSpecName: "util") pod "734906de-b214-4bdf-9fe6-2dec8b04e0da" (UID: "734906de-b214-4bdf-9fe6-2dec8b04e0da"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 21:59:15.788179 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.788103 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2m9r\" (UniqueName: \"kubernetes.io/projected/734906de-b214-4bdf-9fe6-2dec8b04e0da-kube-api-access-l2m9r\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:15.788179 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.788131 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-util\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:15.788179 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:15.788140 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/734906de-b214-4bdf-9fe6-2dec8b04e0da-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 21:59:16.420086 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:16.420034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:16.519406 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:16.519367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" event={"ID":"734906de-b214-4bdf-9fe6-2dec8b04e0da","Type":"ContainerDied","Data":"0f1837247e99667332982f9f21ae34e093b65b2d091c083daf941fef3cf0fddf"} Sep 16 21:59:16.519406 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:16.519405 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avl7ss" Sep 16 21:59:16.519659 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:16.519410 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f1837247e99667332982f9f21ae34e093b65b2d091c083daf941fef3cf0fddf" Sep 16 21:59:22.261287 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:22.261253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:22.360777 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:22.360742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:23.093289 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:23.093253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:23.899562 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:23.899518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:24.691079 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:24.691015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:27.873519 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.873480 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b466dcf74-flv8q"] Sep 16 21:59:27.874018 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.873998 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="util" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874022 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="util" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874039 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="util" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874047 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="util" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874059 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="pull" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874096 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="pull" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874110 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="extract" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874118 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="extract" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874130 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="pull" Sep 16 21:59:27.874137 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874138 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="pull" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874154 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874162 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874172 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874180 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874192 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="util" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874200 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="util" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874214 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874222 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874237 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="util" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874245 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="util" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874254 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="pull" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874262 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="pull" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874271 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="pull" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874279 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="pull" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874372 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="734906de-b214-4bdf-9fe6-2dec8b04e0da" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874386 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="794984aa-c5db-40d4-b2d5-34d3af5cf707" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874398 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1069b9ec-082a-4f46-9aa4-4230f1251e0d" containerName="extract" Sep 16 21:59:27.874591 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.874408 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b100636-8d72-41cb-9683-1102fb6817a3" containerName="extract" Sep 16 21:59:27.878292 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.878271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:27.894034 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.894007 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b466dcf74-flv8q"] Sep 16 21:59:27.966548 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:27.966518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:28.012335 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-serving-cert\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.012529 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-oauth-config\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.012529 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-config\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.012629 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-oauth-serving-cert\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.012629 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-trusted-ca-bundle\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.012730 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-service-ca\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.012785 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.012753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65jv9\" (UniqueName: \"kubernetes.io/projected/eb9cc86c-c441-4e28-a2c3-53321919d97f-kube-api-access-65jv9\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.071908 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.071857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:28.113620 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.113579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-config\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.113810 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.113632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-oauth-serving-cert\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.113810 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.113653 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-trusted-ca-bundle\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.114081 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-service-ca\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.114574 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-trusted-ca-bundle\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.114747 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-config\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.114890 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65jv9\" (UniqueName: \"kubernetes.io/projected/eb9cc86c-c441-4e28-a2c3-53321919d97f-kube-api-access-65jv9\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.114983 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-service-ca\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.115138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-serving-cert\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.115138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.114875 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb9cc86c-c441-4e28-a2c3-53321919d97f-oauth-serving-cert\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.115138 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.115024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-oauth-config\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.117744 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.117708 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-oauth-config\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.117844 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.117790 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb9cc86c-c441-4e28-a2c3-53321919d97f-console-serving-cert\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.130186 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.130130 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65jv9\" (UniqueName: \"kubernetes.io/projected/eb9cc86c-c441-4e28-a2c3-53321919d97f-kube-api-access-65jv9\") pod \"console-7b466dcf74-flv8q\" (UID: \"eb9cc86c-c441-4e28-a2c3-53321919d97f\") " pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.166773 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.166738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:28.195143 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.195113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:28.469120 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.469060 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b466dcf74-flv8q"] Sep 16 21:59:28.470765 ip-10-0-142-168 kubenswrapper[2575]: W0916 21:59:28.470744 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9cc86c_c441_4e28_a2c3_53321919d97f.slice/crio-f7519697f3222dc075541219bdf064d1209649d01f8a5460730961a2725dc26a WatchSource:0}: Error finding container f7519697f3222dc075541219bdf064d1209649d01f8a5460730961a2725dc26a: Status 404 returned error can't find the container with id f7519697f3222dc075541219bdf064d1209649d01f8a5460730961a2725dc26a Sep 16 21:59:28.586819 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.586780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b466dcf74-flv8q" event={"ID":"eb9cc86c-c441-4e28-a2c3-53321919d97f","Type":"ContainerStarted","Data":"9caf634310c2fa6e85c9f1d19c3b9fa85bb1c220e158cde99ec9a1fe7a55deff"} Sep 16 21:59:28.587006 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.586842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b466dcf74-flv8q" event={"ID":"eb9cc86c-c441-4e28-a2c3-53321919d97f","Type":"ContainerStarted","Data":"f7519697f3222dc075541219bdf064d1209649d01f8a5460730961a2725dc26a"} Sep 16 21:59:28.606473 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:28.606425 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b466dcf74-flv8q" podStartSLOduration=1.606409204 podStartE2EDuration="1.606409204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:28.605060823 +0000 UTC m=+617.222423683" watchObservedRunningTime="2026-09-16 21:59:28.606409204 +0000 UTC m=+617.223772062" Sep 16 21:59:29.701126 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:29.701093 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:30.107793 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:30.107759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:30.391931 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:30.391837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:32.714012 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:32.713936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:33.322158 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:33.322130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:33.423615 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:33.423572 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:35.164475 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:35.164449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:37.934443 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:37.934412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:38.028674 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.028638 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:38.128905 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.128873 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:38.195726 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.195653 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:38.195726 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.195702 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:38.200801 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.200777 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:38.224250 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.224224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:38.647304 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.647278 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b466dcf74-flv8q" Sep 16 21:59:38.700353 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.700309 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5877659df4-r6trv"] Sep 16 21:59:38.730913 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.730877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:38.830480 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.830453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:38.931500 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:38.931409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:39.030817 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:39.030783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:39.130986 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:39.130946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:39.201633 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:39.201556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:44.956981 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:44.956946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:45.057422 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:45.057389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:51.524491 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:51.524452 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:51.624564 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:51.624536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:54.519336 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:54.519294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:54.620864 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:54.620829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:59.392860 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:59.392821 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:59.492566 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:59.492529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 21:59:59.550537 ip-10-0-142-168 kubenswrapper[2575]: I0916 21:59:59.550497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:03.727186 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:03.727119 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5877659df4-r6trv" podUID="9e098fd2-bf76-4856-ba18-330392d3cbf9" containerName="console" containerID="cri-o://ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921" gracePeriod=15 Sep 16 22:00:03.970524 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:03.970492 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877659df4-r6trv" Sep 16 22:00:04.050180 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050048 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-trusted-ca-bundle\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050180 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050145 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-serving-cert\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050431 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050254 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-oauth-serving-cert\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050431 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050318 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c4f8\" (UniqueName: \"kubernetes.io/projected/9e098fd2-bf76-4856-ba18-330392d3cbf9-kube-api-access-4c4f8\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050431 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050351 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-config\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050431 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050383 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-oauth-config\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050431 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050414 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-service-ca\") pod \"9e098fd2-bf76-4856-ba18-330392d3cbf9\" (UID: \"9e098fd2-bf76-4856-ba18-330392d3cbf9\") " Sep 16 22:00:04.050675 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050535 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 22:00:04.050675 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050625 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 22:00:04.050758 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050732 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-config" (OuterVolumeSpecName: "console-config") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 22:00:04.050941 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050920 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 22:00:04.050941 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050934 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-config\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.051286 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050954 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-trusted-ca-bundle\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.051286 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.050970 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-oauth-serving-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.052507 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.052485 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 22:00:04.052622 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.052597 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 22:00:04.052622 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.052610 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e098fd2-bf76-4856-ba18-330392d3cbf9-kube-api-access-4c4f8" (OuterVolumeSpecName: "kube-api-access-4c4f8") pod "9e098fd2-bf76-4856-ba18-330392d3cbf9" (UID: "9e098fd2-bf76-4856-ba18-330392d3cbf9"). InnerVolumeSpecName "kube-api-access-4c4f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 22:00:04.152036 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.152002 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-serving-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.152036 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.152033 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c4f8\" (UniqueName: \"kubernetes.io/projected/9e098fd2-bf76-4856-ba18-330392d3cbf9-kube-api-access-4c4f8\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.152270 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.152048 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e098fd2-bf76-4856-ba18-330392d3cbf9-console-oauth-config\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.152270 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.152092 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e098fd2-bf76-4856-ba18-330392d3cbf9-service-ca\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:00:04.794470 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.794432 2575 generic.go:356] "Generic (PLEG): container finished" podID="9e098fd2-bf76-4856-ba18-330392d3cbf9" containerID="ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921" exitCode=0 Sep 16 22:00:04.794918 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.794494 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5877659df4-r6trv" Sep 16 22:00:04.794918 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.794524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877659df4-r6trv" event={"ID":"9e098fd2-bf76-4856-ba18-330392d3cbf9","Type":"ContainerDied","Data":"ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921"} Sep 16 22:00:04.794918 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.794596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5877659df4-r6trv" event={"ID":"9e098fd2-bf76-4856-ba18-330392d3cbf9","Type":"ContainerDied","Data":"5f904aa8630dd3d25977f23c0d2f5d2dd929f7d2273a7e6f58f1c967b439c88e"} Sep 16 22:00:04.794918 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.794617 2575 scope.go:117] "RemoveContainer" containerID="ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921" Sep 16 22:00:04.806291 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.806270 2575 scope.go:117] "RemoveContainer" containerID="ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921" Sep 16 22:00:04.806561 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:00:04.806541 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921\": container with ID starting with ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921 not found: ID does not exist" containerID="ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921" Sep 16 22:00:04.806622 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.806570 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921"} err="failed to get container status \"ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921\": rpc error: code = NotFound desc = could not find container \"ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921\": container with ID starting with ec3e3b31769687a0c906f80a03b5ff64a47b02de2a1ee6b3b3ff9f84f0f96921 not found: ID does not exist" Sep 16 22:00:04.820222 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.820200 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5877659df4-r6trv"] Sep 16 22:00:04.825889 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:04.825868 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5877659df4-r6trv"] Sep 16 22:00:05.849723 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:05.849685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:05.885475 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:05.885446 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e098fd2-bf76-4856-ba18-330392d3cbf9" path="/var/lib/kubelet/pods/9e098fd2-bf76-4856-ba18-330392d3cbf9/volumes" Sep 16 22:00:06.073536 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:06.073488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:12.406460 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:12.406420 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:12.502377 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:12.502346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:15.403465 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:15.403428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:15.504438 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:15.504405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:17.693313 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:17.693279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:17.936414 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:17.936379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:19.421287 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:19.421252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:19.525821 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:19.525789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:19.630184 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:19.630152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:20.248875 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:20.248831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:20.345409 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:20.345375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:20.614512 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:20.614485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:20.665516 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:20.665488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:21.016507 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:21.016429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:21.718325 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:21.718291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:22.859771 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:22.859738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:27.662445 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:27.662405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:27.762744 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:27.762715 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:34.228810 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:34.228772 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:34.328100 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:34.328051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:35.555766 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:35.555730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:35.645796 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:35.645768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:36.037373 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:36.037342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:37.236345 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:37.236309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:37.336250 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:37.336211 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:47.336288 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:47.336259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:52.947277 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:52.947239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:53.173093 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:53.173044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:00:58.846293 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:00:58.846259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:00.565053 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.565020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:00.582219 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.582183 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qk45c"] Sep 16 22:01:00.582774 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.582759 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e098fd2-bf76-4856-ba18-330392d3cbf9" containerName="console" Sep 16 22:01:00.582827 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.582778 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e098fd2-bf76-4856-ba18-330392d3cbf9" containerName="console" Sep 16 22:01:00.582904 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.582887 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e098fd2-bf76-4856-ba18-330392d3cbf9" containerName="console" Sep 16 22:01:00.589086 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.589046 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.596481 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.596458 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 16 22:01:00.596760 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.596518 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mfzc9\"" Sep 16 22:01:00.596915 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.596527 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 16 22:01:00.597248 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.597009 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 16 22:01:00.600499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.600479 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qk45c"] Sep 16 22:01:00.660564 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.660533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:00.668859 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.668835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.668988 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.668872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.668988 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.668890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2qdw\" (UniqueName: \"kubernetes.io/projected/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-kube-api-access-t2qdw\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.745626 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.745591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:00.750506 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.750473 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cb98bc469-8xnx5"] Sep 16 22:01:00.753982 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.753963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.765798 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.765774 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-8xnx5"] Sep 16 22:01:00.769748 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.769726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.769869 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.769759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2qdw\" (UniqueName: \"kubernetes.io/projected/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-kube-api-access-t2qdw\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.769931 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:00.769891 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 16 22:01:00.769991 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:00.769960 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert podName:91c37fb8-bbb5-408e-959d-4c2e6aed64f2 nodeName:}" failed. No retries permitted until 2026-09-16 22:01:01.269937867 +0000 UTC m=+709.887300725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert") pod "maas-controller-75dc6cbdf-qk45c" (UID: "91c37fb8-bbb5-408e-959d-4c2e6aed64f2") : secret "maas-controller-webhook-cert" not found Sep 16 22:01:00.770058 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.770027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.770148 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.770054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.770148 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.770095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-metrics-certs\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.770148 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.770123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2nsl\" (UniqueName: \"kubernetes.io/projected/aae22bc9-32b7-4977-b7f0-f107c50a7a45-kube-api-access-m2nsl\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.770308 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:00.770225 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 16 22:01:00.770308 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:00.770297 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs podName:91c37fb8-bbb5-408e-959d-4c2e6aed64f2 nodeName:}" failed. No retries permitted until 2026-09-16 22:01:01.270277045 +0000 UTC m=+709.887639888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs") pod "maas-controller-75dc6cbdf-qk45c" (UID: "91c37fb8-bbb5-408e-959d-4c2e6aed64f2") : secret "maas-controller-metrics-tls" not found Sep 16 22:01:00.778973 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.778938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2qdw\" (UniqueName: \"kubernetes.io/projected/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-kube-api-access-t2qdw\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:00.870878 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.870846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.870878 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.870886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-metrics-certs\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.871211 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.870918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2nsl\" (UniqueName: \"kubernetes.io/projected/aae22bc9-32b7-4977-b7f0-f107c50a7a45-kube-api-access-m2nsl\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.871211 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:00.871010 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 16 22:01:00.871211 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:00.871126 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert podName:aae22bc9-32b7-4977-b7f0-f107c50a7a45 nodeName:}" failed. No retries permitted until 2026-09-16 22:01:01.371103987 +0000 UTC m=+709.988466827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert") pod "maas-controller-7cb98bc469-8xnx5" (UID: "aae22bc9-32b7-4977-b7f0-f107c50a7a45") : secret "maas-controller-webhook-cert" not found Sep 16 22:01:00.873505 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.873485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-metrics-certs\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.880558 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.880530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2nsl\" (UniqueName: \"kubernetes.io/projected/aae22bc9-32b7-4977-b7f0-f107c50a7a45-kube-api-access-m2nsl\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:00.900223 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.900195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:00.953306 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:00.953261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:01.274536 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.274449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:01.274696 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.274561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:01.277146 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.277115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:01.277274 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.277148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert\") pod \"maas-controller-75dc6cbdf-qk45c\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:01.375586 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.375545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:01.378103 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.378059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert\") pod \"maas-controller-7cb98bc469-8xnx5\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:01.507930 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.507894 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:01.665787 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.665748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:01.778635 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.778604 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qk45c"] Sep 16 22:01:01.779652 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:01:01.779620 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c37fb8_bbb5_408e_959d_4c2e6aed64f2.slice/crio-666eedb047d9978bfa8688adf5f59668b3733e18a36dd88a588a1b44740d8b61 WatchSource:0}: Error finding container 666eedb047d9978bfa8688adf5f59668b3733e18a36dd88a588a1b44740d8b61: Status 404 returned error can't find the container with id 666eedb047d9978bfa8688adf5f59668b3733e18a36dd88a588a1b44740d8b61 Sep 16 22:01:01.781127 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.781111 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 22:01:01.938610 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:01.938584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-8xnx5"] Sep 16 22:01:01.940492 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:01:01.940461 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae22bc9_32b7_4977_b7f0_f107c50a7a45.slice/crio-01cfd8cf328e4e99e9317063396ebe460afa4d58882e48c23b57e0cfa577cb1e WatchSource:0}: Error finding container 01cfd8cf328e4e99e9317063396ebe460afa4d58882e48c23b57e0cfa577cb1e: Status 404 returned error can't find the container with id 01cfd8cf328e4e99e9317063396ebe460afa4d58882e48c23b57e0cfa577cb1e Sep 16 22:01:02.111445 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:02.111407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" event={"ID":"aae22bc9-32b7-4977-b7f0-f107c50a7a45","Type":"ContainerStarted","Data":"01cfd8cf328e4e99e9317063396ebe460afa4d58882e48c23b57e0cfa577cb1e"} Sep 16 22:01:02.112588 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:02.112567 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" event={"ID":"91c37fb8-bbb5-408e-959d-4c2e6aed64f2","Type":"ContainerStarted","Data":"666eedb047d9978bfa8688adf5f59668b3733e18a36dd88a588a1b44740d8b61"} Sep 16 22:01:04.544494 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:04.544462 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:04.651689 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:04.651595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:05.135148 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:05.135114 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" event={"ID":"91c37fb8-bbb5-408e-959d-4c2e6aed64f2","Type":"ContainerStarted","Data":"aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d"} Sep 16 22:01:05.135367 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:05.135182 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:05.136742 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:05.136714 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" event={"ID":"aae22bc9-32b7-4977-b7f0-f107c50a7a45","Type":"ContainerStarted","Data":"76dd2101a3499b57cb31e2dfc3115945f342461bbd05131fdac78dfb7e225f7f"} Sep 16 22:01:05.136853 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:05.136775 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:05.171387 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:05.171330 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" podStartSLOduration=2.582995423 podStartE2EDuration="5.171314887s" totalImagesPullingTime="2.588319464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:01:05.170505527 +0000 UTC m=+713.787868387" watchObservedRunningTime="2026-09-16 22:01:05.171314887 +0000 UTC m=+713.788677746" Sep 16 22:01:05.190377 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:05.190315 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" podStartSLOduration=2.755912892 podStartE2EDuration="5.190294893s" totalImagesPullingTime="2.434382001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:01:05.189645667 +0000 UTC m=+713.807008545" watchObservedRunningTime="2026-09-16 22:01:05.190294893 +0000 UTC m=+713.807657753" Sep 16 22:01:16.144870 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.144840 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:01:16.145368 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.144909 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:16.209990 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.209953 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qk45c"] Sep 16 22:01:16.210239 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.210212 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" podUID="91c37fb8-bbb5-408e-959d-4c2e6aed64f2" containerName="manager" containerID="cri-o://aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d" gracePeriod=30 Sep 16 22:01:16.457226 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.457202 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:16.514124 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.514093 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs\") pod \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " Sep 16 22:01:16.514314 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.514172 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2qdw\" (UniqueName: \"kubernetes.io/projected/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-kube-api-access-t2qdw\") pod \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " Sep 16 22:01:16.514314 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.514249 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert\") pod \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\" (UID: \"91c37fb8-bbb5-408e-959d-4c2e6aed64f2\") " Sep 16 22:01:16.516512 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.516476 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "91c37fb8-bbb5-408e-959d-4c2e6aed64f2" (UID: "91c37fb8-bbb5-408e-959d-4c2e6aed64f2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 22:01:16.516623 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.516509 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91c37fb8-bbb5-408e-959d-4c2e6aed64f2" (UID: "91c37fb8-bbb5-408e-959d-4c2e6aed64f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 22:01:16.516623 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.516520 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-kube-api-access-t2qdw" (OuterVolumeSpecName: "kube-api-access-t2qdw") pod "91c37fb8-bbb5-408e-959d-4c2e6aed64f2" (UID: "91c37fb8-bbb5-408e-959d-4c2e6aed64f2"). InnerVolumeSpecName "kube-api-access-t2qdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 22:01:16.615888 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.615852 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2qdw\" (UniqueName: \"kubernetes.io/projected/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-kube-api-access-t2qdw\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:01:16.615888 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.615883 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-webhook-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:01:16.615888 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:16.615892 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91c37fb8-bbb5-408e-959d-4c2e6aed64f2-metrics-certs\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:01:17.201692 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.201654 2575 generic.go:356] "Generic (PLEG): container finished" podID="91c37fb8-bbb5-408e-959d-4c2e6aed64f2" containerID="aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d" exitCode=0 Sep 16 22:01:17.202118 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.201705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" event={"ID":"91c37fb8-bbb5-408e-959d-4c2e6aed64f2","Type":"ContainerDied","Data":"aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d"} Sep 16 22:01:17.202118 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.201724 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" Sep 16 22:01:17.202118 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.201758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-qk45c" event={"ID":"91c37fb8-bbb5-408e-959d-4c2e6aed64f2","Type":"ContainerDied","Data":"666eedb047d9978bfa8688adf5f59668b3733e18a36dd88a588a1b44740d8b61"} Sep 16 22:01:17.202118 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.201787 2575 scope.go:117] "RemoveContainer" containerID="aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d" Sep 16 22:01:17.211713 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.211578 2575 scope.go:117] "RemoveContainer" containerID="aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d" Sep 16 22:01:17.211869 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:01:17.211851 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d\": container with ID starting with aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d not found: ID does not exist" containerID="aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d" Sep 16 22:01:17.211907 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.211877 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d"} err="failed to get container status \"aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d\": rpc error: code = NotFound desc = could not find container \"aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d\": container with ID starting with aae9a5402394ceca67f19c2e96dbb047f14b60c6d5c32ca51e3dd548b4030b3d not found: ID does not exist" Sep 16 22:01:17.223954 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.223927 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qk45c"] Sep 16 22:01:17.227556 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.227533 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-qk45c"] Sep 16 22:01:17.885628 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:17.885595 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91c37fb8-bbb5-408e-959d-4c2e6aed64f2" path="/var/lib/kubelet/pods/91c37fb8-bbb5-408e-959d-4c2e6aed64f2/volumes" Sep 16 22:01:34.672802 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:34.672768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:34.771305 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:34.771257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.134846 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.134810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.218084 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.218041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.551237 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.551118 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.691455 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.691425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.797458 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.797422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.879636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.879606 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q6827"] Sep 16 22:01:36.880111 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.880095 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91c37fb8-bbb5-408e-959d-4c2e6aed64f2" containerName="manager" Sep 16 22:01:36.880217 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.880115 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="91c37fb8-bbb5-408e-959d-4c2e6aed64f2" containerName="manager" Sep 16 22:01:36.880217 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.880208 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="91c37fb8-bbb5-408e-959d-4c2e6aed64f2" containerName="manager" Sep 16 22:01:36.882470 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.882450 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:36.884829 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.884788 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kk7q8\"" Sep 16 22:01:36.884983 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.884972 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 16 22:01:36.889237 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.889037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:36.894080 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.894043 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q6827"] Sep 16 22:01:36.903214 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.903189 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2drpb"] Sep 16 22:01:36.906600 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.906581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:36.906826 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.906766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4d27ece-f348-407b-ac13-086a7be22075-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-q6827\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:36.907002 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.906983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqn2h\" (UniqueName: \"kubernetes.io/projected/f4d27ece-f348-407b-ac13-086a7be22075-kube-api-access-jqn2h\") pod \"payload-pre-processing-59fbc47bf8-q6827\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:36.919610 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:36.919584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2drpb"] Sep 16 22:01:37.008121 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.008092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktw8\" (UniqueName: \"kubernetes.io/projected/a3239df6-0570-4a29-8d40-90d687eff452-kube-api-access-dktw8\") pod \"payload-processing-5b54b7fbb7-2drpb\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.008284 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.008133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4d27ece-f348-407b-ac13-086a7be22075-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-q6827\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:37.008284 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.008151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3239df6-0570-4a29-8d40-90d687eff452-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2drpb\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.008284 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.008181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqn2h\" (UniqueName: \"kubernetes.io/projected/f4d27ece-f348-407b-ac13-086a7be22075-kube-api-access-jqn2h\") pod \"payload-pre-processing-59fbc47bf8-q6827\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:37.008869 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.008850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4d27ece-f348-407b-ac13-086a7be22075-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-q6827\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:37.016266 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.016244 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqn2h\" (UniqueName: \"kubernetes.io/projected/f4d27ece-f348-407b-ac13-086a7be22075-kube-api-access-jqn2h\") pod \"payload-pre-processing-59fbc47bf8-q6827\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:37.109340 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.109307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktw8\" (UniqueName: \"kubernetes.io/projected/a3239df6-0570-4a29-8d40-90d687eff452-kube-api-access-dktw8\") pod \"payload-processing-5b54b7fbb7-2drpb\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.109506 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.109360 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3239df6-0570-4a29-8d40-90d687eff452-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2drpb\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.110120 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.110099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3239df6-0570-4a29-8d40-90d687eff452-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2drpb\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.129615 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.129585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktw8\" (UniqueName: \"kubernetes.io/projected/a3239df6-0570-4a29-8d40-90d687eff452-kube-api-access-dktw8\") pod \"payload-processing-5b54b7fbb7-2drpb\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.193416 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.193337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:37.217434 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.217406 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:37.472939 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.472890 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q6827"] Sep 16 22:01:37.473973 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:01:37.473946 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d27ece_f348_407b_ac13_086a7be22075.slice/crio-f428f7ac2e3d03765d80ac614dae3cf6b3a4f88532f8bec32055d5c40a87bdf5 WatchSource:0}: Error finding container f428f7ac2e3d03765d80ac614dae3cf6b3a4f88532f8bec32055d5c40a87bdf5: Status 404 returned error can't find the container with id f428f7ac2e3d03765d80ac614dae3cf6b3a4f88532f8bec32055d5c40a87bdf5 Sep 16 22:01:37.505634 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:37.505612 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2drpb"] Sep 16 22:01:37.506805 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:01:37.506782 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3239df6_0570_4a29_8d40_90d687eff452.slice/crio-42904320f79d99fd2955c7cf444f6abaf52f22f2c68b123b27bdbdcbe0ff6676 WatchSource:0}: Error finding container 42904320f79d99fd2955c7cf444f6abaf52f22f2c68b123b27bdbdcbe0ff6676: Status 404 returned error can't find the container with id 42904320f79d99fd2955c7cf444f6abaf52f22f2c68b123b27bdbdcbe0ff6676 Sep 16 22:01:38.324013 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:38.323970 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" event={"ID":"f4d27ece-f348-407b-ac13-086a7be22075","Type":"ContainerStarted","Data":"f428f7ac2e3d03765d80ac614dae3cf6b3a4f88532f8bec32055d5c40a87bdf5"} Sep 16 22:01:38.325874 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:38.325846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" event={"ID":"a3239df6-0570-4a29-8d40-90d687eff452","Type":"ContainerStarted","Data":"42904320f79d99fd2955c7cf444f6abaf52f22f2c68b123b27bdbdcbe0ff6676"} Sep 16 22:01:39.333131 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:39.333015 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" event={"ID":"a3239df6-0570-4a29-8d40-90d687eff452","Type":"ContainerStarted","Data":"c7cd1318c8529d0e6540255ee632105f2e53303491c2cc7d1056218c466133fa"} Sep 16 22:01:39.333131 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:39.333113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:39.334678 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:39.334655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" event={"ID":"f4d27ece-f348-407b-ac13-086a7be22075","Type":"ContainerStarted","Data":"fc6a4fbf0bb30ec826e02b9dec7837557b9115035ad9dce8fa396dbe52fa7ebd"} Sep 16 22:01:39.334793 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:39.334772 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:01:39.351907 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:39.351860 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" podStartSLOduration=1.912528665 podStartE2EDuration="3.351845977s" totalImagesPullingTime="1.439317312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:01:39.350216149 +0000 UTC m=+747.967579009" watchObservedRunningTime="2026-09-16 22:01:39.351845977 +0000 UTC m=+747.969208836" Sep 16 22:01:39.365278 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:39.365237 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" podStartSLOduration=1.893732009 podStartE2EDuration="3.36522674s" totalImagesPullingTime="1.471494731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:01:39.364330434 +0000 UTC m=+747.981693322" watchObservedRunningTime="2026-09-16 22:01:39.36522674 +0000 UTC m=+747.982589599" Sep 16 22:01:47.836218 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:47.836183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:47.900274 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:47.900240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:01:50.347080 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:50.347043 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:01:50.347564 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:01:50.347160 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:02:01.185046 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.185012 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6"] Sep 16 22:02:01.187969 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.187947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.191543 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.191520 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 16 22:02:01.191669 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.191542 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 16 22:02:01.191669 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.191573 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 16 22:02:01.191669 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.191602 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qf59f\"" Sep 16 22:02:01.200747 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.200718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6"] Sep 16 22:02:01.219185 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.219161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:02:01.326760 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.326724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.326924 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.326764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzttc\" (UniqueName: \"kubernetes.io/projected/fbb306be-2fcc-42b8-88df-42b43b569b7b-kube-api-access-xzttc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.326924 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.326791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.326924 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.326862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.326924 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.326903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb306be-2fcc-42b8-88df-42b43b569b7b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.327057 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.327003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428080 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428272 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzttc\" (UniqueName: \"kubernetes.io/projected/fbb306be-2fcc-42b8-88df-42b43b569b7b-kube-api-access-xzttc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428272 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428272 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428272 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb306be-2fcc-42b8-88df-42b43b569b7b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428482 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428539 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428539 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.428642 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.428568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.430735 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.430711 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbb306be-2fcc-42b8-88df-42b43b569b7b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.431029 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.431009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbb306be-2fcc-42b8-88df-42b43b569b7b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.435651 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.435599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzttc\" (UniqueName: \"kubernetes.io/projected/fbb306be-2fcc-42b8-88df-42b43b569b7b-kube-api-access-xzttc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6\" (UID: \"fbb306be-2fcc-42b8-88df-42b43b569b7b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.499433 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.499389 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:01.772539 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:01.772512 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6"] Sep 16 22:02:01.773437 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:02:01.773417 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb306be_2fcc_42b8_88df_42b43b569b7b.slice/crio-2d112f4f2e95d8895a8aa4f87c7056b4beaa87697caf71868cc5094f9526120a WatchSource:0}: Error finding container 2d112f4f2e95d8895a8aa4f87c7056b4beaa87697caf71868cc5094f9526120a: Status 404 returned error can't find the container with id 2d112f4f2e95d8895a8aa4f87c7056b4beaa87697caf71868cc5094f9526120a Sep 16 22:02:02.470496 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:02.470459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" event={"ID":"fbb306be-2fcc-42b8-88df-42b43b569b7b","Type":"ContainerStarted","Data":"2d112f4f2e95d8895a8aa4f87c7056b4beaa87697caf71868cc5094f9526120a"} Sep 16 22:02:03.477765 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:03.477729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" event={"ID":"fbb306be-2fcc-42b8-88df-42b43b569b7b","Type":"ContainerStarted","Data":"64eaba48aae1f43677c0d80d29f658f8cc0ca177b9044adedae49827be1b24f4"} Sep 16 22:02:03.498787 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:03.498720 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" podStartSLOduration=1.437869932 podStartE2EDuration="2.498696314s" totalImagesPullingTime="1.060826382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:02:03.493665468 +0000 UTC m=+772.111028326" watchObservedRunningTime="2026-09-16 22:02:03.498696314 +0000 UTC m=+772.116059174" Sep 16 22:02:08.300713 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:08.300682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:02:11.500486 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:11.500440 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:11.500894 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:11.500536 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:11.513287 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:11.513251 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:11.534149 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:11.534118 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rvsk6" Sep 16 22:02:20.515678 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:20.515647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:02:28.315383 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:28.315341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:02:48.618445 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:48.618355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:02:55.904372 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:02:55.904330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:03:07.762717 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:03:07.762683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:03:56.714839 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:03:56.714802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:05.849914 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:05.849837 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:09.787948 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:09.787914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:09.889110 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:09.889082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:24.718407 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:24.718371 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:24.778691 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:24.778662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:24.891270 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:24.891237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:28.991715 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:28.991677 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:29.127439 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.127387 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2drpb"] Sep 16 22:04:29.127674 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.127642 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" podUID="a3239df6-0570-4a29-8d40-90d687eff452" containerName="payload-processing" containerID="cri-o://c7cd1318c8529d0e6540255ee632105f2e53303491c2cc7d1056218c466133fa" gracePeriod=30 Sep 16 22:04:29.144390 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.144358 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q6827"] Sep 16 22:04:29.144572 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.144550 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" podUID="f4d27ece-f348-407b-ac13-086a7be22075" containerName="payload-pre-processing" containerID="cri-o://fc6a4fbf0bb30ec826e02b9dec7837557b9115035ad9dce8fa396dbe52fa7ebd" gracePeriod=30 Sep 16 22:04:29.181114 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.181057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:29.183338 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.183309 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-8xnx5"] Sep 16 22:04:29.183572 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.183546 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" podUID="aae22bc9-32b7-4977-b7f0-f107c50a7a45" containerName="manager" containerID="cri-o://76dd2101a3499b57cb31e2dfc3115945f342461bbd05131fdac78dfb7e225f7f" gracePeriod=30 Sep 16 22:04:29.305613 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.305588 2575 generic.go:356] "Generic (PLEG): container finished" podID="f4d27ece-f348-407b-ac13-086a7be22075" containerID="fc6a4fbf0bb30ec826e02b9dec7837557b9115035ad9dce8fa396dbe52fa7ebd" exitCode=0 Sep 16 22:04:29.305716 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.305661 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" event={"ID":"f4d27ece-f348-407b-ac13-086a7be22075","Type":"ContainerDied","Data":"fc6a4fbf0bb30ec826e02b9dec7837557b9115035ad9dce8fa396dbe52fa7ebd"} Sep 16 22:04:29.307568 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.307536 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3239df6-0570-4a29-8d40-90d687eff452" containerID="c7cd1318c8529d0e6540255ee632105f2e53303491c2cc7d1056218c466133fa" exitCode=0 Sep 16 22:04:29.307666 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.307572 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" event={"ID":"a3239df6-0570-4a29-8d40-90d687eff452","Type":"ContainerDied","Data":"c7cd1318c8529d0e6540255ee632105f2e53303491c2cc7d1056218c466133fa"} Sep 16 22:04:29.309665 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.309615 2575 generic.go:356] "Generic (PLEG): container finished" podID="aae22bc9-32b7-4977-b7f0-f107c50a7a45" containerID="76dd2101a3499b57cb31e2dfc3115945f342461bbd05131fdac78dfb7e225f7f" exitCode=0 Sep 16 22:04:29.309665 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.309652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" event={"ID":"aae22bc9-32b7-4977-b7f0-f107c50a7a45","Type":"ContainerDied","Data":"76dd2101a3499b57cb31e2dfc3115945f342461bbd05131fdac78dfb7e225f7f"} Sep 16 22:04:29.433367 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.433346 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:04:29.455638 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.455615 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:04:29.466017 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.465994 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509267 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4d27ece-f348-407b-ac13-086a7be22075-plugins-config-volume\") pod \"f4d27ece-f348-407b-ac13-086a7be22075\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509377 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dktw8\" (UniqueName: \"kubernetes.io/projected/a3239df6-0570-4a29-8d40-90d687eff452-kube-api-access-dktw8\") pod \"a3239df6-0570-4a29-8d40-90d687eff452\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509504 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert\") pod \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509587 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-metrics-certs\") pod \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509651 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqn2h\" (UniqueName: \"kubernetes.io/projected/f4d27ece-f348-407b-ac13-086a7be22075-kube-api-access-jqn2h\") pod \"f4d27ece-f348-407b-ac13-086a7be22075\" (UID: \"f4d27ece-f348-407b-ac13-086a7be22075\") " Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509698 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3239df6-0570-4a29-8d40-90d687eff452-plugins-config-volume\") pod \"a3239df6-0570-4a29-8d40-90d687eff452\" (UID: \"a3239df6-0570-4a29-8d40-90d687eff452\") " Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509758 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d27ece-f348-407b-ac13-086a7be22075-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4d27ece-f348-407b-ac13-086a7be22075" (UID: "f4d27ece-f348-407b-ac13-086a7be22075"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 22:04:29.509868 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.509768 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2nsl\" (UniqueName: \"kubernetes.io/projected/aae22bc9-32b7-4977-b7f0-f107c50a7a45-kube-api-access-m2nsl\") pod \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\" (UID: \"aae22bc9-32b7-4977-b7f0-f107c50a7a45\") " Sep 16 22:04:29.510554 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.510310 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4d27ece-f348-407b-ac13-086a7be22075-plugins-config-volume\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:29.510554 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.510407 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3239df6-0570-4a29-8d40-90d687eff452-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3239df6-0570-4a29-8d40-90d687eff452" (UID: "a3239df6-0570-4a29-8d40-90d687eff452"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 22:04:29.513005 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.512974 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d27ece-f348-407b-ac13-086a7be22075-kube-api-access-jqn2h" (OuterVolumeSpecName: "kube-api-access-jqn2h") pod "f4d27ece-f348-407b-ac13-086a7be22075" (UID: "f4d27ece-f348-407b-ac13-086a7be22075"). InnerVolumeSpecName "kube-api-access-jqn2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 22:04:29.513167 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.513012 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae22bc9-32b7-4977-b7f0-f107c50a7a45-kube-api-access-m2nsl" (OuterVolumeSpecName: "kube-api-access-m2nsl") pod "aae22bc9-32b7-4977-b7f0-f107c50a7a45" (UID: "aae22bc9-32b7-4977-b7f0-f107c50a7a45"). InnerVolumeSpecName "kube-api-access-m2nsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 22:04:29.513288 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.513264 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3239df6-0570-4a29-8d40-90d687eff452-kube-api-access-dktw8" (OuterVolumeSpecName: "kube-api-access-dktw8") pod "a3239df6-0570-4a29-8d40-90d687eff452" (UID: "a3239df6-0570-4a29-8d40-90d687eff452"). InnerVolumeSpecName "kube-api-access-dktw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 22:04:29.514171 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.514135 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aae22bc9-32b7-4977-b7f0-f107c50a7a45" (UID: "aae22bc9-32b7-4977-b7f0-f107c50a7a45"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 22:04:29.514457 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.514433 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "aae22bc9-32b7-4977-b7f0-f107c50a7a45" (UID: "aae22bc9-32b7-4977-b7f0-f107c50a7a45"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 22:04:29.560751 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.560717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:29.611042 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.610992 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2nsl\" (UniqueName: \"kubernetes.io/projected/aae22bc9-32b7-4977-b7f0-f107c50a7a45-kube-api-access-m2nsl\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:29.611042 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.611035 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dktw8\" (UniqueName: \"kubernetes.io/projected/a3239df6-0570-4a29-8d40-90d687eff452-kube-api-access-dktw8\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:29.611042 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.611049 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-webhook-cert\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:29.611305 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.611090 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aae22bc9-32b7-4977-b7f0-f107c50a7a45-metrics-certs\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:29.611305 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.611104 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqn2h\" (UniqueName: \"kubernetes.io/projected/f4d27ece-f348-407b-ac13-086a7be22075-kube-api-access-jqn2h\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:29.611305 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:29.611118 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3239df6-0570-4a29-8d40-90d687eff452-plugins-config-volume\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:04:30.207881 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.207794 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cb98bc469-gf6j4"] Sep 16 22:04:30.208392 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208373 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3239df6-0570-4a29-8d40-90d687eff452" containerName="payload-processing" Sep 16 22:04:30.208499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208397 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3239df6-0570-4a29-8d40-90d687eff452" containerName="payload-processing" Sep 16 22:04:30.208499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208419 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae22bc9-32b7-4977-b7f0-f107c50a7a45" containerName="manager" Sep 16 22:04:30.208499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208429 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae22bc9-32b7-4977-b7f0-f107c50a7a45" containerName="manager" Sep 16 22:04:30.208499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208441 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d27ece-f348-407b-ac13-086a7be22075" containerName="payload-pre-processing" Sep 16 22:04:30.208499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208449 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d27ece-f348-407b-ac13-086a7be22075" containerName="payload-pre-processing" Sep 16 22:04:30.208739 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208555 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d27ece-f348-407b-ac13-086a7be22075" containerName="payload-pre-processing" Sep 16 22:04:30.208739 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208570 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3239df6-0570-4a29-8d40-90d687eff452" containerName="payload-processing" Sep 16 22:04:30.208739 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.208581 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae22bc9-32b7-4977-b7f0-f107c50a7a45" containerName="manager" Sep 16 22:04:30.211950 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.211930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.222223 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.222200 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-gf6j4"] Sep 16 22:04:30.316559 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.316522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8k5m\" (UniqueName: \"kubernetes.io/projected/dbade458-9457-49d4-840c-b01e60fc11e4-kube-api-access-p8k5m\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.316722 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.316579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbade458-9457-49d4-840c-b01e60fc11e4-webhook-cert\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.316722 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.316656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbade458-9457-49d4-840c-b01e60fc11e4-metrics-certs\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.316851 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.316815 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" Sep 16 22:04:30.316913 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.316844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb98bc469-8xnx5" event={"ID":"aae22bc9-32b7-4977-b7f0-f107c50a7a45","Type":"ContainerDied","Data":"01cfd8cf328e4e99e9317063396ebe460afa4d58882e48c23b57e0cfa577cb1e"} Sep 16 22:04:30.316913 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.316899 2575 scope.go:117] "RemoveContainer" containerID="76dd2101a3499b57cb31e2dfc3115945f342461bbd05131fdac78dfb7e225f7f" Sep 16 22:04:30.318457 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.318347 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" Sep 16 22:04:30.318457 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.318386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-q6827" event={"ID":"f4d27ece-f348-407b-ac13-086a7be22075","Type":"ContainerDied","Data":"f428f7ac2e3d03765d80ac614dae3cf6b3a4f88532f8bec32055d5c40a87bdf5"} Sep 16 22:04:30.319947 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.319918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" event={"ID":"a3239df6-0570-4a29-8d40-90d687eff452","Type":"ContainerDied","Data":"42904320f79d99fd2955c7cf444f6abaf52f22f2c68b123b27bdbdcbe0ff6676"} Sep 16 22:04:30.320086 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.319928 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2drpb" Sep 16 22:04:30.327258 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.327237 2575 scope.go:117] "RemoveContainer" containerID="fc6a4fbf0bb30ec826e02b9dec7837557b9115035ad9dce8fa396dbe52fa7ebd" Sep 16 22:04:30.335167 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.335138 2575 scope.go:117] "RemoveContainer" containerID="c7cd1318c8529d0e6540255ee632105f2e53303491c2cc7d1056218c466133fa" Sep 16 22:04:30.339828 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.339808 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2drpb"] Sep 16 22:04:30.346614 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.346586 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2drpb"] Sep 16 22:04:30.355824 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.355802 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q6827"] Sep 16 22:04:30.360223 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.360206 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-q6827"] Sep 16 22:04:30.369935 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.369898 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-8xnx5"] Sep 16 22:04:30.372018 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.371997 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-8xnx5"] Sep 16 22:04:30.417801 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.417767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8k5m\" (UniqueName: \"kubernetes.io/projected/dbade458-9457-49d4-840c-b01e60fc11e4-kube-api-access-p8k5m\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.417937 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.417818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbade458-9457-49d4-840c-b01e60fc11e4-webhook-cert\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.417937 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.417877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbade458-9457-49d4-840c-b01e60fc11e4-metrics-certs\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.420608 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.420587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbade458-9457-49d4-840c-b01e60fc11e4-webhook-cert\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.420698 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.420608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbade458-9457-49d4-840c-b01e60fc11e4-metrics-certs\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.425317 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.425296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8k5m\" (UniqueName: \"kubernetes.io/projected/dbade458-9457-49d4-840c-b01e60fc11e4-kube-api-access-p8k5m\") pod \"maas-controller-7cb98bc469-gf6j4\" (UID: \"dbade458-9457-49d4-840c-b01e60fc11e4\") " pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.522309 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.522220 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:30.796085 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:30.796034 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cb98bc469-gf6j4"] Sep 16 22:04:30.797893 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:04:30.797868 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbade458_9457_49d4_840c_b01e60fc11e4.slice/crio-666994f51844486ccc3137a902da55578093d0756d0ce6ea25354d5561a2d5a7 WatchSource:0}: Error finding container 666994f51844486ccc3137a902da55578093d0756d0ce6ea25354d5561a2d5a7: Status 404 returned error can't find the container with id 666994f51844486ccc3137a902da55578093d0756d0ce6ea25354d5561a2d5a7 Sep 16 22:04:31.330154 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:31.330114 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" event={"ID":"dbade458-9457-49d4-840c-b01e60fc11e4","Type":"ContainerStarted","Data":"666994f51844486ccc3137a902da55578093d0756d0ce6ea25354d5561a2d5a7"} Sep 16 22:04:31.520025 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:31.519994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:31.886818 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:31.886788 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3239df6-0570-4a29-8d40-90d687eff452" path="/var/lib/kubelet/pods/a3239df6-0570-4a29-8d40-90d687eff452/volumes" Sep 16 22:04:31.887166 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:31.887152 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae22bc9-32b7-4977-b7f0-f107c50a7a45" path="/var/lib/kubelet/pods/aae22bc9-32b7-4977-b7f0-f107c50a7a45/volumes" Sep 16 22:04:31.887499 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:31.887487 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d27ece-f348-407b-ac13-086a7be22075" path="/var/lib/kubelet/pods/f4d27ece-f348-407b-ac13-086a7be22075/volumes" Sep 16 22:04:32.345715 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:32.345617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" event={"ID":"dbade458-9457-49d4-840c-b01e60fc11e4","Type":"ContainerStarted","Data":"ea25d88cc35586b985272af18c8f67aca35351237645565062036c7984acfbf2"} Sep 16 22:04:32.346138 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:32.345768 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:32.361487 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:32.361437 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" podStartSLOduration=1.781910482 podStartE2EDuration="2.361423614s" totalImagesPullingTime="579.513132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:04:32.360384156 +0000 UTC m=+920.977747014" watchObservedRunningTime="2026-09-16 22:04:32.361423614 +0000 UTC m=+920.978786499" Sep 16 22:04:43.354167 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.354139 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cb98bc469-gf6j4" Sep 16 22:04:43.598592 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.598555 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-cddd46b6-9rpwj"] Sep 16 22:04:43.602143 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.602122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:43.604517 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.604456 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 16 22:04:43.604517 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.604467 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-5n7k6\"" Sep 16 22:04:43.609616 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.609592 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-cddd46b6-9rpwj"] Sep 16 22:04:43.740239 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.740204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp8lx\" (UniqueName: \"kubernetes.io/projected/824a2afe-9b34-424a-99ba-cac0a3089d11-kube-api-access-qp8lx\") pod \"ai-gateway-controller-cddd46b6-9rpwj\" (UID: \"824a2afe-9b34-424a-99ba-cac0a3089d11\") " pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:43.841640 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.841601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp8lx\" (UniqueName: \"kubernetes.io/projected/824a2afe-9b34-424a-99ba-cac0a3089d11-kube-api-access-qp8lx\") pod \"ai-gateway-controller-cddd46b6-9rpwj\" (UID: \"824a2afe-9b34-424a-99ba-cac0a3089d11\") " pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:43.849453 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.849429 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp8lx\" (UniqueName: \"kubernetes.io/projected/824a2afe-9b34-424a-99ba-cac0a3089d11-kube-api-access-qp8lx\") pod \"ai-gateway-controller-cddd46b6-9rpwj\" (UID: \"824a2afe-9b34-424a-99ba-cac0a3089d11\") " pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:43.914159 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:43.914087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:44.186089 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:44.186044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-cddd46b6-9rpwj"] Sep 16 22:04:44.187925 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:04:44.187896 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824a2afe_9b34_424a_99ba_cac0a3089d11.slice/crio-fc5dabd1d6917b0b1b851a3eacbd28c376955e333e279320f34c151e85cd2c60 WatchSource:0}: Error finding container fc5dabd1d6917b0b1b851a3eacbd28c376955e333e279320f34c151e85cd2c60: Status 404 returned error can't find the container with id fc5dabd1d6917b0b1b851a3eacbd28c376955e333e279320f34c151e85cd2c60 Sep 16 22:04:44.415741 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:44.415704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" event={"ID":"824a2afe-9b34-424a-99ba-cac0a3089d11","Type":"ContainerStarted","Data":"fc5dabd1d6917b0b1b851a3eacbd28c376955e333e279320f34c151e85cd2c60"} Sep 16 22:04:46.033850 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.033764 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-t2rks"] Sep 16 22:04:46.037540 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.037515 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.040132 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.040107 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 16 22:04:46.040259 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.040110 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kk7q8\"" Sep 16 22:04:46.045009 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.044984 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-t2rks"] Sep 16 22:04:46.066227 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.066193 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-5g84h"] Sep 16 22:04:46.070109 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.070085 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.074396 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.074352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:46.080918 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.080895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-5g84h"] Sep 16 22:04:46.164664 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.164624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122c86d-f905-4e71-8c23-008228ac6f9f-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-5g84h\" (UID: \"0122c86d-f905-4e71-8c23-008228ac6f9f\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.164850 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.164680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15767cf3-3a31-4033-b591-18cfb17e8295-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-t2rks\" (UID: \"15767cf3-3a31-4033-b591-18cfb17e8295\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.164850 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.164736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv6gq\" (UniqueName: \"kubernetes.io/projected/15767cf3-3a31-4033-b591-18cfb17e8295-kube-api-access-xv6gq\") pod \"payload-processing-5d7dbbd56b-t2rks\" (UID: \"15767cf3-3a31-4033-b591-18cfb17e8295\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.164850 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.164758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbt6k\" (UniqueName: \"kubernetes.io/projected/0122c86d-f905-4e71-8c23-008228ac6f9f-kube-api-access-lbt6k\") pod \"payload-pre-processing-6cd864bc95-5g84h\" (UID: \"0122c86d-f905-4e71-8c23-008228ac6f9f\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.172588 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.172558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:46.266324 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.266287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv6gq\" (UniqueName: \"kubernetes.io/projected/15767cf3-3a31-4033-b591-18cfb17e8295-kube-api-access-xv6gq\") pod \"payload-processing-5d7dbbd56b-t2rks\" (UID: \"15767cf3-3a31-4033-b591-18cfb17e8295\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.266324 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.266324 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbt6k\" (UniqueName: \"kubernetes.io/projected/0122c86d-f905-4e71-8c23-008228ac6f9f-kube-api-access-lbt6k\") pod \"payload-pre-processing-6cd864bc95-5g84h\" (UID: \"0122c86d-f905-4e71-8c23-008228ac6f9f\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.266586 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.266408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122c86d-f905-4e71-8c23-008228ac6f9f-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-5g84h\" (UID: \"0122c86d-f905-4e71-8c23-008228ac6f9f\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.266586 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.266435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15767cf3-3a31-4033-b591-18cfb17e8295-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-t2rks\" (UID: \"15767cf3-3a31-4033-b591-18cfb17e8295\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.267241 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.267222 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15767cf3-3a31-4033-b591-18cfb17e8295-plugins-config-volume\") pod \"payload-processing-5d7dbbd56b-t2rks\" (UID: \"15767cf3-3a31-4033-b591-18cfb17e8295\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.267308 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.267290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0122c86d-f905-4e71-8c23-008228ac6f9f-plugins-config-volume\") pod \"payload-pre-processing-6cd864bc95-5g84h\" (UID: \"0122c86d-f905-4e71-8c23-008228ac6f9f\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.274404 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.274379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv6gq\" (UniqueName: \"kubernetes.io/projected/15767cf3-3a31-4033-b591-18cfb17e8295-kube-api-access-xv6gq\") pod \"payload-processing-5d7dbbd56b-t2rks\" (UID: \"15767cf3-3a31-4033-b591-18cfb17e8295\") " pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.274504 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.274485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbt6k\" (UniqueName: \"kubernetes.io/projected/0122c86d-f905-4e71-8c23-008228ac6f9f-kube-api-access-lbt6k\") pod \"payload-pre-processing-6cd864bc95-5g84h\" (UID: \"0122c86d-f905-4e71-8c23-008228ac6f9f\") " pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.350346 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.350317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:46.381740 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.381700 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:46.432660 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.431824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" event={"ID":"824a2afe-9b34-424a-99ba-cac0a3089d11","Type":"ContainerStarted","Data":"f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5"} Sep 16 22:04:46.432660 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.432320 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:46.451510 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.451458 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" podStartSLOduration=2.013039991 podStartE2EDuration="3.451436525s" totalImagesPullingTime="1.438396534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:04:46.44743639 +0000 UTC m=+935.064799249" watchObservedRunningTime="2026-09-16 22:04:46.451436525 +0000 UTC m=+935.068799385" Sep 16 22:04:46.622270 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.622243 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5d7dbbd56b-t2rks"] Sep 16 22:04:46.623724 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:04:46.623695 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15767cf3_3a31_4033_b591_18cfb17e8295.slice/crio-2518f0d96dcf5fe25f8ffeb72c9137d6a2bf54a18e9ba121808feda01227d74c WatchSource:0}: Error finding container 2518f0d96dcf5fe25f8ffeb72c9137d6a2bf54a18e9ba121808feda01227d74c: Status 404 returned error can't find the container with id 2518f0d96dcf5fe25f8ffeb72c9137d6a2bf54a18e9ba121808feda01227d74c Sep 16 22:04:46.657984 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:46.657959 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-6cd864bc95-5g84h"] Sep 16 22:04:46.658982 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:04:46.658953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0122c86d_f905_4e71_8c23_008228ac6f9f.slice/crio-ca8ab45cbc6a3380cd2788709b53ccaafbe787e3b3191acafd221a09c15bb39b WatchSource:0}: Error finding container ca8ab45cbc6a3380cd2788709b53ccaafbe787e3b3191acafd221a09c15bb39b: Status 404 returned error can't find the container with id ca8ab45cbc6a3380cd2788709b53ccaafbe787e3b3191acafd221a09c15bb39b Sep 16 22:04:47.438995 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:47.438959 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" event={"ID":"15767cf3-3a31-4033-b591-18cfb17e8295","Type":"ContainerStarted","Data":"2518f0d96dcf5fe25f8ffeb72c9137d6a2bf54a18e9ba121808feda01227d74c"} Sep 16 22:04:47.440316 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:47.440297 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" event={"ID":"0122c86d-f905-4e71-8c23-008228ac6f9f","Type":"ContainerStarted","Data":"ca8ab45cbc6a3380cd2788709b53ccaafbe787e3b3191acafd221a09c15bb39b"} Sep 16 22:04:49.454575 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:49.454468 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" event={"ID":"15767cf3-3a31-4033-b591-18cfb17e8295","Type":"ContainerStarted","Data":"36ca3898865785dc3d40f636a92266501089c23d1a38de33860cbd9eafbd8a6e"} Sep 16 22:04:49.455000 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:49.454577 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:04:49.456115 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:49.456088 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" event={"ID":"0122c86d-f905-4e71-8c23-008228ac6f9f","Type":"ContainerStarted","Data":"dc810136843927e8624965bd788067de85f3241b23d2d3129f8a29da647facbc"} Sep 16 22:04:49.456253 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:49.456135 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:04:49.469433 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:49.469387 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" podStartSLOduration=0.901848668 podStartE2EDuration="3.469373286s" totalImagesPullingTime="2.567524618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:04:49.468028761 +0000 UTC m=+938.085391620" watchObservedRunningTime="2026-09-16 22:04:49.469373286 +0000 UTC m=+938.086736144" Sep 16 22:04:49.484001 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:49.483963 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" podStartSLOduration=0.94530252 podStartE2EDuration="3.483950085s" totalImagesPullingTime="2.538647565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:04:49.481536517 +0000 UTC m=+938.098899388" watchObservedRunningTime="2026-09-16 22:04:49.483950085 +0000 UTC m=+938.101312944" Sep 16 22:04:50.683398 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:50.683363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:04:57.443000 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.442964 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:04:57.619189 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.619149 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w"] Sep 16 22:04:57.623015 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.622994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:04:57.630791 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.630761 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w"] Sep 16 22:04:57.774492 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.774402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dklhw\" (UniqueName: \"kubernetes.io/projected/532d1be6-258f-485a-9b51-4c98b2cf4de8-kube-api-access-dklhw\") pod \"ai-gateway-controller-bc65b7bb5-lfq6w\" (UID: \"532d1be6-258f-485a-9b51-4c98b2cf4de8\") " pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:04:57.875840 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.875802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dklhw\" (UniqueName: \"kubernetes.io/projected/532d1be6-258f-485a-9b51-4c98b2cf4de8-kube-api-access-dklhw\") pod \"ai-gateway-controller-bc65b7bb5-lfq6w\" (UID: \"532d1be6-258f-485a-9b51-4c98b2cf4de8\") " pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:04:57.884504 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.884474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklhw\" (UniqueName: \"kubernetes.io/projected/532d1be6-258f-485a-9b51-4c98b2cf4de8-kube-api-access-dklhw\") pod \"ai-gateway-controller-bc65b7bb5-lfq6w\" (UID: \"532d1be6-258f-485a-9b51-4c98b2cf4de8\") " pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:04:57.935424 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:57.935395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:04:58.207323 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:58.207295 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w"] Sep 16 22:04:58.208507 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:04:58.208482 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532d1be6_258f_485a_9b51_4c98b2cf4de8.slice/crio-a359bafa026879df48bdd818d83638235c0216c03ff27f6fa9779e9c00772aff WatchSource:0}: Error finding container a359bafa026879df48bdd818d83638235c0216c03ff27f6fa9779e9c00772aff: Status 404 returned error can't find the container with id a359bafa026879df48bdd818d83638235c0216c03ff27f6fa9779e9c00772aff Sep 16 22:04:58.511583 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:58.511494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" event={"ID":"532d1be6-258f-485a-9b51-4c98b2cf4de8","Type":"ContainerStarted","Data":"a359bafa026879df48bdd818d83638235c0216c03ff27f6fa9779e9c00772aff"} Sep 16 22:04:59.519038 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:59.519004 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" event={"ID":"532d1be6-258f-485a-9b51-4c98b2cf4de8","Type":"ContainerStarted","Data":"784ac1345e1f44d804a557cca746f55d49bd56841de71ee5a2bb59de86f92e44"} Sep 16 22:04:59.519492 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:59.519118 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:04:59.536174 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:04:59.536125 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" podStartSLOduration=2.115041738 podStartE2EDuration="2.536110713s" totalImagesPullingTime="421.068975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:04:59.533744432 +0000 UTC m=+948.151107292" watchObservedRunningTime="2026-09-16 22:04:59.536110713 +0000 UTC m=+948.153473571" Sep 16 22:05:00.464350 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:00.464318 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" Sep 16 22:05:00.464636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:00.464394 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" Sep 16 22:05:00.464904 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:00.464885 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:05:00.465026 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:00.465008 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:05:10.527438 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.527410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-bc65b7bb5-lfq6w" Sep 16 22:05:10.566083 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.566039 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-cddd46b6-9rpwj"] Sep 16 22:05:10.566281 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.566258 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" podUID="824a2afe-9b34-424a-99ba-cac0a3089d11" containerName="manager" containerID="cri-o://f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5" gracePeriod=30 Sep 16 22:05:10.811543 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.811520 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:05:10.893985 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.893951 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp8lx\" (UniqueName: \"kubernetes.io/projected/824a2afe-9b34-424a-99ba-cac0a3089d11-kube-api-access-qp8lx\") pod \"824a2afe-9b34-424a-99ba-cac0a3089d11\" (UID: \"824a2afe-9b34-424a-99ba-cac0a3089d11\") " Sep 16 22:05:10.896145 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.896122 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824a2afe-9b34-424a-99ba-cac0a3089d11-kube-api-access-qp8lx" (OuterVolumeSpecName: "kube-api-access-qp8lx") pod "824a2afe-9b34-424a-99ba-cac0a3089d11" (UID: "824a2afe-9b34-424a-99ba-cac0a3089d11"). InnerVolumeSpecName "kube-api-access-qp8lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 22:05:10.995281 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:10.995242 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp8lx\" (UniqueName: \"kubernetes.io/projected/824a2afe-9b34-424a-99ba-cac0a3089d11-kube-api-access-qp8lx\") on node \"ip-10-0-142-168.ec2.internal\" DevicePath \"\"" Sep 16 22:05:11.587564 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.587533 2575 generic.go:356] "Generic (PLEG): container finished" podID="824a2afe-9b34-424a-99ba-cac0a3089d11" containerID="f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5" exitCode=0 Sep 16 22:05:11.587977 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.587576 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" Sep 16 22:05:11.587977 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.587618 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" event={"ID":"824a2afe-9b34-424a-99ba-cac0a3089d11","Type":"ContainerDied","Data":"f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5"} Sep 16 22:05:11.587977 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.587670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-cddd46b6-9rpwj" event={"ID":"824a2afe-9b34-424a-99ba-cac0a3089d11","Type":"ContainerDied","Data":"fc5dabd1d6917b0b1b851a3eacbd28c376955e333e279320f34c151e85cd2c60"} Sep 16 22:05:11.587977 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.587691 2575 scope.go:117] "RemoveContainer" containerID="f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5" Sep 16 22:05:11.597508 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.597492 2575 scope.go:117] "RemoveContainer" containerID="f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5" Sep 16 22:05:11.597795 ip-10-0-142-168 kubenswrapper[2575]: E0916 22:05:11.597772 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5\": container with ID starting with f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5 not found: ID does not exist" containerID="f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5" Sep 16 22:05:11.597840 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.597803 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5"} err="failed to get container status \"f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5\": rpc error: code = NotFound desc = could not find container \"f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5\": container with ID starting with f95233a50f39cc0992f6fd5b1e985be4790460689c9e418a384ac2b95fa4ebd5 not found: ID does not exist" Sep 16 22:05:11.612176 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.612156 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-cddd46b6-9rpwj"] Sep 16 22:05:11.614501 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.614481 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-cddd46b6-9rpwj"] Sep 16 22:05:11.763436 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.763403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:05:11.886380 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:11.886356 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824a2afe-9b34-424a-99ba-cac0a3089d11" path="/var/lib/kubelet/pods/824a2afe-9b34-424a-99ba-cac0a3089d11/volumes" Sep 16 22:05:12.096237 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:12.096194 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:05:38.444703 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:05:38.444615 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:06:10.879886 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:06:10.879857 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:06:12.880838 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:06:12.880794 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:07:27.880646 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:07:27.880552 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:07:32.880787 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:07:32.880756 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:08:19.386539 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:08:19.386507 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:08:19.919472 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:08:19.919442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:08:34.880056 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:08:34.879981 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:08:37.880082 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:08:37.880039 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:09:50.879872 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:09:50.879842 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:10:02.880766 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:10:02.880679 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:10:22.885330 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:10:22.885293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:10:51.883395 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:10:51.883354 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:11:05.888239 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:11:05.881838 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:12:13.880829 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:12:13.880791 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:12:27.879898 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:12:27.879863 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:13:15.886486 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:13:15.886415 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:13:49.880425 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:13:49.880386 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-pre-processing-6cd864bc95-5g84h" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:14:19.104385 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:19.104354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:14:19.195309 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:19.195278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" limit=1024 Sep 16 22:14:21.169496 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:21.169465 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6wls8_593ba305-2eaf-4f74-830d-00b910be26a2/global-pull-secret-syncer/0.log" Sep 16 22:14:21.311935 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:21.311905 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9zll6_db0d1bde-1bc1-4d19-9cf0-598e1c127756/konnectivity-agent/0.log" Sep 16 22:14:21.435989 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:21.435911 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-168.ec2.internal_120b065a204276bba7b5eb34956aed54/haproxy/0.log" Sep 16 22:14:27.718175 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.718148 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/alertmanager/0.log" Sep 16 22:14:27.736101 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.736058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/config-reloader/0.log" Sep 16 22:14:27.753660 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.753628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/kube-rbac-proxy-web/0.log" Sep 16 22:14:27.773566 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.773542 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/kube-rbac-proxy/0.log" Sep 16 22:14:27.792576 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.792540 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/kube-rbac-proxy-metric/0.log" Sep 16 22:14:27.820888 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.820861 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/prom-label-proxy/0.log" Sep 16 22:14:27.841902 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.841881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f438fe0a-8d92-4465-a856-75e307f99dde/init-config-reloader/0.log" Sep 16 22:14:27.878687 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.878657 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-5srws_24732cb0-e397-49b0-80bd-ff99e0b6164b/cluster-monitoring-operator/0.log" Sep 16 22:14:27.905711 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.905680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-9kp75_5abcdbce-fb2f-4547-bb9d-9bfb555613d0/kube-state-metrics/0.log" Sep 16 22:14:27.928030 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.928006 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-9kp75_5abcdbce-fb2f-4547-bb9d-9bfb555613d0/kube-rbac-proxy-main/0.log" Sep 16 22:14:27.945284 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.945259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-9kp75_5abcdbce-fb2f-4547-bb9d-9bfb555613d0/kube-rbac-proxy-self/0.log" Sep 16 22:14:27.971851 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:27.971775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-856bc9bbd7-tbhsq_22d542c9-204a-4b7b-bb2f-6adf216ef50f/metrics-server/0.log" Sep 16 22:14:28.033405 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.033376 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85gk_d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c/node-exporter/0.log" Sep 16 22:14:28.054296 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.054266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85gk_d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c/kube-rbac-proxy/0.log" Sep 16 22:14:28.073507 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.073488 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85gk_d25d3c6b-2ec3-4b36-b533-8b9d4f7ee95c/init-textfile/0.log" Sep 16 22:14:28.236747 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.236660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-p6t9c_17e5a00d-eff9-43e0-8964-5ba04754f5fc/kube-rbac-proxy-main/0.log" Sep 16 22:14:28.254947 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.254920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-p6t9c_17e5a00d-eff9-43e0-8964-5ba04754f5fc/kube-rbac-proxy-self/0.log" Sep 16 22:14:28.281980 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.281953 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-p6t9c_17e5a00d-eff9-43e0-8964-5ba04754f5fc/openshift-state-metrics/0.log" Sep 16 22:14:28.591472 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.591391 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74665797c7-nr2rz_af19e1da-8e03-4650-85c5-0e77c65ed601/telemeter-client/0.log" Sep 16 22:14:28.611624 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.611601 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74665797c7-nr2rz_af19e1da-8e03-4650-85c5-0e77c65ed601/reload/0.log" Sep 16 22:14:28.629284 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.629262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74665797c7-nr2rz_af19e1da-8e03-4650-85c5-0e77c65ed601/kube-rbac-proxy/0.log" Sep 16 22:14:28.656536 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.656516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/thanos-query/0.log" Sep 16 22:14:28.673519 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.673499 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy-web/0.log" Sep 16 22:14:28.692714 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.692690 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy/0.log" Sep 16 22:14:28.710828 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.710807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/prom-label-proxy/0.log" Sep 16 22:14:28.728396 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.728377 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy-rules/0.log" Sep 16 22:14:28.747676 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:28.747652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7ff87b7ff6-q7ksj_eb798833-e71d-4a37-8df4-f6cd83c1a081/kube-rbac-proxy-metrics/0.log" Sep 16 22:14:31.386122 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.386089 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp"] Sep 16 22:14:31.388413 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.386500 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824a2afe-9b34-424a-99ba-cac0a3089d11" containerName="manager" Sep 16 22:14:31.388413 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.386511 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="824a2afe-9b34-424a-99ba-cac0a3089d11" containerName="manager" Sep 16 22:14:31.388413 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.386581 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="824a2afe-9b34-424a-99ba-cac0a3089d11" containerName="manager" Sep 16 22:14:31.389491 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.389476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.392018 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.391993 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sk4xn\"/\"openshift-service-ca.crt\"" Sep 16 22:14:31.392018 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.392018 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sk4xn\"/\"default-dockercfg-tqklh\"" Sep 16 22:14:31.392245 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.391993 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sk4xn\"/\"kube-root-ca.crt\"" Sep 16 22:14:31.399038 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.399015 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp"] Sep 16 22:14:31.440456 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.440425 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b466dcf74-flv8q_eb9cc86c-c441-4e28-a2c3-53321919d97f/console/0.log" Sep 16 22:14:31.471305 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.471277 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-5s8n9_4f226e73-b0be-42dc-819f-000772fdc0bc/download-server/0.log" Sep 16 22:14:31.488364 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.488335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-sys\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.488508 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.488381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-lib-modules\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.488508 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.488412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggl4x\" (UniqueName: \"kubernetes.io/projected/fc2acae9-687c-4589-a5ed-398886aee39e-kube-api-access-ggl4x\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.488508 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.488469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-proc\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.488698 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.488558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-podres\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589472 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-sys\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-lib-modules\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggl4x\" (UniqueName: \"kubernetes.io/projected/fc2acae9-687c-4589-a5ed-398886aee39e-kube-api-access-ggl4x\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589540 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-proc\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-podres\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589636 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589582 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-sys\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589844 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589633 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-lib-modules\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589844 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589654 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-proc\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.589844 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.589687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc2acae9-687c-4589-a5ed-398886aee39e-podres\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.600525 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.600498 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggl4x\" (UniqueName: \"kubernetes.io/projected/fc2acae9-687c-4589-a5ed-398886aee39e-kube-api-access-ggl4x\") pod \"perf-node-gather-daemonset-p4lcp\" (UID: \"fc2acae9-687c-4589-a5ed-398886aee39e\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.700261 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.700190 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:31.971515 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:31.971484 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp"] Sep 16 22:14:31.972750 ip-10-0-142-168 kubenswrapper[2575]: W0916 22:14:31.972719 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc2acae9_687c_4589_a5ed_398886aee39e.slice/crio-64d2e1adcd9f184a0271761da909e505697d17233c73cdf2f41f87e89abcb521 WatchSource:0}: Error finding container 64d2e1adcd9f184a0271761da909e505697d17233c73cdf2f41f87e89abcb521: Status 404 returned error can't find the container with id 64d2e1adcd9f184a0271761da909e505697d17233c73cdf2f41f87e89abcb521 Sep 16 22:14:32.795451 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:32.795371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" event={"ID":"fc2acae9-687c-4589-a5ed-398886aee39e","Type":"ContainerStarted","Data":"a2ba470a6821995e8b08947ee37aea2c1eeddb918bf956346a21d864985b3ab3"} Sep 16 22:14:32.795451 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:32.795424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" event={"ID":"fc2acae9-687c-4589-a5ed-398886aee39e","Type":"ContainerStarted","Data":"64d2e1adcd9f184a0271761da909e505697d17233c73cdf2f41f87e89abcb521"} Sep 16 22:14:32.795855 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:32.795491 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:32.810368 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:32.810325 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" podStartSLOduration=1.810307871 podStartE2EDuration="1.810307871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 22:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:14:32.808659427 +0000 UTC m=+1521.426022289" watchObservedRunningTime="2026-09-16 22:14:32.810307871 +0000 UTC m=+1521.427670732" Sep 16 22:14:33.252469 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:33.252438 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q7g62_2913d3f1-05b2-4968-b68f-93d666b2ed82/dns/0.log" Sep 16 22:14:33.269258 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:33.269221 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q7g62_2913d3f1-05b2-4968-b68f-93d666b2ed82/kube-rbac-proxy/0.log" Sep 16 22:14:33.291003 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:33.290973 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hd65k_7d17bf83-68f1-4996-acf8-cf9cc688ac9b/dns-node-resolver/0.log" Sep 16 22:14:33.848774 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:33.848742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7768cdff84-gxct5_ab016d94-ddd9-4c51-a920-6ea4ea6a1624/registry/0.log" Sep 16 22:14:33.915501 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:33.915461 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ngkgc_80ba37ea-2c67-4471-8c7e-47cbda4e4753/node-ca/0.log" Sep 16 22:14:34.857551 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:34.857520 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ft5fx_698de614-4e03-46ca-b9a5-2169874c71f5/discovery/0.log" Sep 16 22:14:34.999765 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:34.999736 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-5g84h_0122c86d-f905-4e71-8c23-008228ac6f9f/payload-pre-processing/0.log" Sep 16 22:14:35.032675 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:35.032635 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-t2rks_15767cf3-3a31-4033-b591-18cfb17e8295/payload-processing/0.log" Sep 16 22:14:35.698441 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:35.698414 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mktwb_01a1f86b-e86c-4c85-af68-e9b2327015b2/serve-healthcheck-canary/0.log" Sep 16 22:14:35.880344 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:35.880310 2575 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/payload-processing-5d7dbbd56b-t2rks" secret="" err="secret \"payload-processing-dockercfg-kk7q8\" not found" Sep 16 22:14:36.216873 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:36.216840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzqvm_848730f9-aef7-4f05-8e71-cea08eff0779/kube-rbac-proxy/0.log" Sep 16 22:14:36.234130 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:36.234096 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzqvm_848730f9-aef7-4f05-8e71-cea08eff0779/exporter/0.log" Sep 16 22:14:36.252835 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:36.252809 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzqvm_848730f9-aef7-4f05-8e71-cea08eff0779/extractor/0.log" Sep 16 22:14:38.425574 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:38.425544 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bc65b7bb5-lfq6w_532d1be6-258f-485a-9b51-4c98b2cf4de8/manager/0.log" Sep 16 22:14:38.521945 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:38.521916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cb98bc469-gf6j4_dbade458-9457-49d4-840c-b01e60fc11e4/manager/0.log" Sep 16 22:14:38.540795 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:38.540773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r59nr_fd74dc6f-f4a9-421c-bb7b-61f29b2d0023/server/0.log" Sep 16 22:14:38.719138 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:38.719041 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8655b7f9cc-h5mvr_e39c06c9-f132-4bba-984a-4f7bcaab758d/manager/0.log" Sep 16 22:14:38.736392 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:38.736367 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8655b7f9cc-h5mvr_e39c06c9-f132-4bba-984a-4f7bcaab758d/copy-manifests/0.log" Sep 16 22:14:38.812493 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:38.812468 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-p4lcp" Sep 16 22:14:39.991027 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:39.991003 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68dbcd7456-gv24p_aa9b1ae0-ff65-4e70-95c3-faca3175f468/manager/0.log" Sep 16 22:14:40.038840 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:40.038814 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pbjtd_3b9b76f1-cc41-4b1b-98af-d8d38d02d02e/openshift-lws-operator/0.log" Sep 16 22:14:41.981885 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:41.981857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ft5fx_698de614-4e03-46ca-b9a5-2169874c71f5/discovery/0.log" Sep 16 22:14:42.036773 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:42.036747 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-5g84h_0122c86d-f905-4e71-8c23-008228ac6f9f/payload-pre-processing/0.log" Sep 16 22:14:42.055407 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:42.055377 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-t2rks_15767cf3-3a31-4033-b591-18cfb17e8295/payload-processing/0.log" Sep 16 22:14:43.360748 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:43.360715 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-ft5fx_698de614-4e03-46ca-b9a5-2169874c71f5/discovery/0.log" Sep 16 22:14:43.420180 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:43.420098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-6cd864bc95-5g84h_0122c86d-f905-4e71-8c23-008228ac6f9f/payload-pre-processing/0.log" Sep 16 22:14:43.435192 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:43.435167 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5d7dbbd56b-t2rks_15767cf3-3a31-4033-b591-18cfb17e8295/payload-processing/0.log" Sep 16 22:14:45.791541 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:45.791506 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-tv52t_461bd19e-9421-4cb1-9b1e-7c26bc656388/kube-storage-version-migrator-operator/1.log" Sep 16 22:14:45.793178 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:45.793150 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-tv52t_461bd19e-9421-4cb1-9b1e-7c26bc656388/kube-storage-version-migrator-operator/0.log" Sep 16 22:14:46.722395 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.722366 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/kube-multus-additional-cni-plugins/0.log" Sep 16 22:14:46.741687 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.741653 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/egress-router-binary-copy/0.log" Sep 16 22:14:46.758355 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.758329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/cni-plugins/0.log" Sep 16 22:14:46.775052 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.775024 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/bond-cni-plugin/0.log" Sep 16 22:14:46.795093 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.795049 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/routeoverride-cni/0.log" Sep 16 22:14:46.811615 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.811568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/whereabouts-cni-bincopy/0.log" Sep 16 22:14:46.830583 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:46.830558 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bcfrs_03c0257e-db92-46d2-a4e7-24b601504022/whereabouts-cni/0.log" Sep 16 22:14:47.221433 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:47.221133 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rmj2b_554c602e-8d33-486b-88f8-cd67717ffc0b/kube-multus/0.log" Sep 16 22:14:47.321295 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:47.321254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wvmvr_72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e/network-metrics-daemon/0.log" Sep 16 22:14:47.336111 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:47.336077 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wvmvr_72d0bb3d-f5e8-4f85-bbda-89a8838c6e8e/kube-rbac-proxy/0.log" Sep 16 22:14:48.570310 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.570282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/ovn-controller/0.log" Sep 16 22:14:48.585740 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.585694 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/ovn-acl-logging/0.log" Sep 16 22:14:48.611591 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.611562 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/kube-rbac-proxy-node/0.log" Sep 16 22:14:48.634192 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.634157 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/kube-rbac-proxy-ovn-metrics/0.log" Sep 16 22:14:48.649644 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.649610 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/northd/0.log" Sep 16 22:14:48.667371 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.667346 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/nbdb/0.log" Sep 16 22:14:48.686768 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.686743 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/sbdb/0.log" Sep 16 22:14:48.744377 ip-10-0-142-168 kubenswrapper[2575]: I0916 22:14:48.744334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tplfl_42913e30-c690-4951-94f5-6ec37cee6572/ovnkube-controller/0.log"