Sep 05 02:34:27.896988 ip-10-0-136-88 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 05 02:34:27.897000 ip-10-0-136-88 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 05 02:34:27.897007 ip-10-0-136-88 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 05 02:34:27.897258 ip-10-0-136-88 systemd[1]: Failed to start Kubernetes Kubelet. Sep 05 02:34:37.976800 ip-10-0-136-88 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 05 02:34:37.976816 ip-10-0-136-88 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 245d46275f2b42d5b8076c7af03646c5 -- Sep 05 02:36:27.273908 ip-10-0-136-88 systemd[1]: Starting Kubernetes Kubelet... Sep 05 02:36:27.658499 ip-10-0-136-88 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 05 02:36:27.658499 ip-10-0-136-88 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 05 02:36:27.658499 ip-10-0-136-88 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 05 02:36:27.658499 ip-10-0-136-88 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 05 02:36:27.658499 ip-10-0-136-88 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 05 02:36:27.659570 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.659481 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 05 02:36:27.664259 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664243 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:36:27.664259 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664259 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664265 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664268 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664271 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664274 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664276 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664279 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664282 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664284 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664287 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664291 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664294 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664296 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664298 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664301 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664303 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664306 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664309 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664311 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664314 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:36:27.664324 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664317 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664319 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664322 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664324 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664327 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664337 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664340 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664343 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664345 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664348 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664350 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664352 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664355 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664358 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664360 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664363 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664365 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664368 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664371 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:36:27.664828 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664375 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664378 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664383 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664387 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664390 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664393 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664395 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664398 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664401 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664403 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664406 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664409 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664412 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664415 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664418 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664422 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664425 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664428 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664430 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:36:27.665294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664434 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664438 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664441 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664444 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664446 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664449 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664452 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664455 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664459 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664461 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664464 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664467 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664470 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664473 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664476 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664478 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664482 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664485 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664487 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664490 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:36:27.665775 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664493 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664496 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664499 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664501 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664504 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664507 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664510 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664513 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664517 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664520 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664523 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664525 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664528 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664530 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664533 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664535 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664538 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664540 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664543 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.664546 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:36:27.666298 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665249 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665256 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665259 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665262 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665264 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665267 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665269 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665272 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665275 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665279 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665281 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665284 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665286 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665289 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665292 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665294 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665297 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665300 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665303 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665306 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:36:27.666810 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665312 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665317 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665320 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665323 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665326 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665329 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665332 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665335 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665338 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665341 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665343 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665346 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665348 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665351 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665354 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665357 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665359 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665362 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665364 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665367 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:36:27.667310 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665370 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665372 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665375 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665378 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665380 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665383 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665385 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665387 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665390 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665392 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665395 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665397 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665401 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665403 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665406 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665408 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665411 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665413 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665416 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665418 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:36:27.667807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665420 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665423 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665425 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665428 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665430 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665433 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665435 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665437 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665440 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665442 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665445 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665447 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665450 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665453 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665455 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665458 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665461 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665465 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665469 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:36:27.668294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665472 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665474 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665477 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665480 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665482 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665485 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665488 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665491 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665494 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665498 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665500 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665503 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665505 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665508 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665510 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665513 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665515 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665518 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665520 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665523 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:36:27.668807 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665913 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665918 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665920 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665923 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665926 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665928 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665931 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665933 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665936 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665939 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665941 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665944 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665946 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665949 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665952 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665954 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665957 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665960 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665962 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665965 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:36:27.669392 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665967 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665970 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665973 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665975 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665977 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665980 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665982 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665984 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665987 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665990 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665992 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665995 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.665997 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666002 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666005 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666008 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666011 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666013 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666016 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:36:27.669906 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666019 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666022 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666025 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666027 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666030 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666033 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666036 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666039 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666042 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666044 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666047 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666050 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666052 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666054 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666057 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666059 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666062 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666064 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666067 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:36:27.670362 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666071 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666073 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666076 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666079 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666082 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666084 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666090 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666092 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666095 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666097 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666100 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666102 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666105 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666107 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666110 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666112 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666122 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666125 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666128 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666130 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:36:27.670855 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666133 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666136 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666139 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666142 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666145 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666147 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666150 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666152 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666155 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666157 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666159 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666163 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666166 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666169 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666171 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666174 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666176 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666183 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666186 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:36:27.671365 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666188 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666263 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666295 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666305 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666310 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666314 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666317 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666322 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666326 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666335 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666338 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666342 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666346 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666349 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666352 2577 flags.go:64] FLAG: --cgroup-root="" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666355 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666357 2577 flags.go:64] FLAG: --client-ca-file="" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666360 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666363 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666370 2577 flags.go:64] FLAG: --cluster-domain="" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666372 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666375 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666379 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666383 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 05 02:36:27.671879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666387 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666390 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666393 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666396 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666399 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666402 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666406 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666409 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666412 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666416 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666419 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666422 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666425 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666428 2577 flags.go:64] FLAG: --enable-server="true" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666431 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666435 2577 flags.go:64] FLAG: --event-burst="100" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666438 2577 flags.go:64] FLAG: --event-qps="50" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666441 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666445 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666449 2577 flags.go:64] FLAG: --eviction-hard="" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666453 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666456 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666459 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666462 2577 flags.go:64] FLAG: --eviction-soft="" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666464 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 05 02:36:27.672465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666467 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666470 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666473 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666475 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666478 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666481 2577 flags.go:64] FLAG: --feature-gates="" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666484 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666487 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666490 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666493 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666496 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666499 2577 flags.go:64] FLAG: --help="false" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666502 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-136-88.ec2.internal" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666505 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666508 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666511 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666514 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666517 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666520 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666523 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666526 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666529 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666531 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666534 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 05 02:36:27.673098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666537 2577 flags.go:64] FLAG: --kube-reserved="" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666540 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666545 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666548 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666550 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666553 2577 flags.go:64] FLAG: --lock-file="" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666556 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666568 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666572 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666577 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666580 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666583 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666586 2577 flags.go:64] FLAG: --logging-format="text" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666589 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666593 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666595 2577 flags.go:64] FLAG: --manifest-url="" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666598 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666605 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666608 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666612 2577 flags.go:64] FLAG: --max-pods="110" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666616 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666619 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666622 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666625 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666628 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 05 02:36:27.673733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666631 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666634 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666655 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666658 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666661 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666664 2577 flags.go:64] FLAG: --pod-cidr="" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666667 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666673 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666675 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666679 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666690 2577 flags.go:64] FLAG: --port="10250" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666693 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666696 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-098e673f42004331d" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666699 2577 flags.go:64] FLAG: --qos-reserved="" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666702 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666705 2577 flags.go:64] FLAG: --register-node="true" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666708 2577 flags.go:64] FLAG: --register-with-taints="" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666712 2577 flags.go:64] FLAG: --registry-burst="10" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666715 2577 flags.go:64] FLAG: --registry-qps="5" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666717 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666720 2577 flags.go:64] FLAG: --reserved-memory="" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666723 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666726 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666729 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666732 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 05 02:36:27.674349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666735 2577 flags.go:64] FLAG: --runonce="false" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666738 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666741 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666744 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666747 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666749 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666752 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666755 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666758 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666761 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666763 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666766 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666769 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666772 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666775 2577 flags.go:64] FLAG: --system-cgroups="" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666777 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666783 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666786 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666795 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666798 2577 flags.go:64] FLAG: --tls-min-version="" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666801 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666804 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666807 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666810 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666813 2577 flags.go:64] FLAG: --v="2" Sep 05 02:36:27.675013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666817 2577 flags.go:64] FLAG: --version="false" Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666821 2577 flags.go:64] FLAG: --vmodule="" Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666825 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.666828 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666961 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666965 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666968 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666971 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666973 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666976 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666980 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666982 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666985 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666987 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666990 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666993 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666995 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.666998 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667000 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667003 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:36:27.675615 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667005 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667007 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667010 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667012 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667016 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667019 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667022 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667026 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667030 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667033 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667036 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667039 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667041 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667044 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667047 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667049 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667052 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667054 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667057 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667059 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:36:27.676117 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667062 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667064 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667069 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667073 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667076 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667079 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667081 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667084 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667086 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667089 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667092 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667094 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667097 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667099 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667102 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667104 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667108 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667111 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667114 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:36:27.676591 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667117 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667119 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667121 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667124 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667126 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667129 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667132 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667134 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667137 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667139 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667141 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667144 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667147 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667151 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667155 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667161 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667163 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667166 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667169 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667171 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:36:27.677083 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667173 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667176 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667178 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667181 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667183 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667185 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667188 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667190 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667193 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667197 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667199 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667202 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667205 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667208 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667211 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667214 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667216 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667220 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667223 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667227 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:36:27.677573 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667229 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667231 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667234 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.667236 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.667242 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.675028 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.675047 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.676660 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.676671 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676743 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676748 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676752 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676755 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676758 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676761 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:36:27.678119 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676764 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676766 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676769 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676772 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676775 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676777 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676780 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676783 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676785 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676788 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676791 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676793 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676796 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676798 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676801 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676804 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676806 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676809 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676811 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676814 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:36:27.678498 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676816 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676819 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676822 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676831 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676833 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676836 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676838 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676841 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676843 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676845 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676848 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676851 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676853 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676856 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676858 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676861 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676863 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676866 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676869 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:36:27.679021 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676873 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676877 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676879 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676882 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676885 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676889 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676891 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676894 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676897 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676899 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676902 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676904 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676907 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676909 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676912 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676914 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676917 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676925 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676928 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676930 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:36:27.679494 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676933 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676935 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676938 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676940 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676943 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676945 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676948 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676950 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676953 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676956 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676958 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676960 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676963 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676965 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676968 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676970 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676974 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676977 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676980 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:36:27.680036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676983 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676986 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676988 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676991 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676994 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.676997 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677000 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677003 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677007 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677010 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677013 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677022 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677025 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677027 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:36:27.680519 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677030 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.677035 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677199 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677205 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677208 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677210 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677213 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677216 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677218 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677221 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677223 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677226 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677228 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677231 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677233 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:36:27.680959 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677235 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677238 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677240 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677243 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677245 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677248 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677252 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677255 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677257 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677260 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677262 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677265 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677267 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677270 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677273 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677282 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677285 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677288 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677290 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677292 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:36:27.681339 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677295 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677297 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677300 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677302 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677305 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677307 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677310 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677312 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677314 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677317 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677319 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677321 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677324 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677327 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677329 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677331 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677334 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677336 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677339 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677341 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:36:27.681929 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677344 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677346 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677349 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677351 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677354 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677362 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677364 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677367 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677375 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677377 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677380 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677382 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677384 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677387 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677389 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677392 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677394 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677396 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677399 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677401 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:36:27.682415 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677403 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677406 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677408 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677412 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677415 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677418 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677421 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677423 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677426 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677428 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677432 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677435 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677438 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677441 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677444 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677446 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677449 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677451 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:36:27.683034 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677454 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677456 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677459 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677467 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677469 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677472 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677474 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:27.677476 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.677482 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.677611 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.679824 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.680729 2577 server.go:1019] "Starting client certificate rotation" Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.680844 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 05 02:36:27.683477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.681732 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 05 02:36:27.683912 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.683487 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 05 02:36:27.686463 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.686439 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 05 02:36:27.697792 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.697772 2577 log.go:25] "Validated CRI v1 runtime API" Sep 05 02:36:27.700840 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.700822 2577 log.go:25] "Validated CRI v1 image API" Sep 05 02:36:27.701670 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.701637 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 05 02:36:27.706040 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.706015 2577 fs.go:135] Filesystem UUIDs: map[6f079ad1-6cc4-42b9-b752-21345c35301a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a4debb05-dbd2-4f18-9bfa-0c8758f2fafa:/dev/nvme0n1p4] Sep 05 02:36:27.706100 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.706041 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 05 02:36:27.711739 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.711617 2577 manager.go:216] Machine: {Timestamp:2026-09-05 02:36:27.710220628 +0000 UTC m=+0.325611616 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098707 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb2b830eb133c23faaa00b63ce3e1 SystemUUID:ec2fb2b8-30eb-133c-23fa-aa00b63ce3e1 BootID:245d4627-5f2b-42d5-b807-6c7af03646c5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:bd:66:02:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:bd:66:02:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:c6:1b:9b:b5:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 05 02:36:27.711739 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.711737 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 05 02:36:27.711840 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.711823 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 05 02:36:27.715133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.715103 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 05 02:36:27.715285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.715138 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-88.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 05 02:36:27.715952 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.715942 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 05 02:36:27.715991 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.715954 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 05 02:36:27.715991 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.715962 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 05 02:36:27.716656 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.716636 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 05 02:36:27.718312 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.718298 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 05 02:36:27.721398 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721378 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 05 02:36:27.721446 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721422 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 05 02:36:27.721580 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721570 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 05 02:36:27.721610 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721600 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 05 02:36:27.721653 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721631 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 05 02:36:27.721682 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721661 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 05 02:36:27.721718 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721686 2577 kubelet.go:398] "Adding apiserver pod source" Sep 05 02:36:27.721718 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.721695 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 05 02:36:27.722157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.722131 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 05 02:36:27.722249 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.722162 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 05 02:36:27.724541 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.724519 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 05 02:36:27.727842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.727825 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 05 02:36:27.727912 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.727856 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 05 02:36:27.728022 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728012 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 05 02:36:27.728075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728027 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 05 02:36:27.728075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728033 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 05 02:36:27.728075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728039 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 05 02:36:27.728075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728046 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 05 02:36:27.728075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728052 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 05 02:36:27.728615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728604 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 05 02:36:27.728670 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728617 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 05 02:36:27.728670 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728625 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 05 02:36:27.728670 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728631 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 05 02:36:27.728753 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728683 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 05 02:36:27.728753 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.728706 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 05 02:36:27.729843 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.729819 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 05 02:36:27.729932 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.729855 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 05 02:36:27.731544 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.731523 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 05 02:36:27.731544 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.731526 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 05 02:36:27.733969 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.733956 2577 server.go:1268] "Started kubelet" Sep 05 02:36:27.734050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.734005 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 05 02:36:27.734106 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.734061 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 05 02:36:27.734157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.734128 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 05 02:36:27.734816 ip-10-0-136-88 systemd[1]: Started Kubernetes Kubelet. Sep 05 02:36:27.736054 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.735553 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-88.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 05 02:36:27.736326 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.736312 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 05 02:36:27.738081 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.738064 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 05 02:36:27.740981 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.739931 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-88.ec2.internal.18d24c33e1bec941 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-88.ec2.internal,UID:ip-10-0-136-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-88.ec2.internal,},FirstTimestamp:2026-09-05 02:36:27.733928257 +0000 UTC m=+0.349319244,LastTimestamp:2026-09-05 02:36:27.733928257 +0000 UTC m=+0.349319244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-88.ec2.internal,}" Sep 05 02:36:27.741486 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.741465 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 05 02:36:27.741606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.741593 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 05 02:36:27.741684 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.741609 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 05 02:36:27.742226 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742207 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 05 02:36:27.742295 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742230 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 05 02:36:27.742295 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742248 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 05 02:36:27.742378 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.742153 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:27.742378 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742346 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 05 02:36:27.742378 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742354 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 05 02:36:27.742543 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742523 2577 factory.go:55] Registering systemd factory Sep 05 02:36:27.742621 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742585 2577 factory.go:223] Registration of the systemd container factory successfully Sep 05 02:36:27.742876 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742838 2577 factory.go:153] Registering CRI-O factory Sep 05 02:36:27.742876 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742852 2577 factory.go:223] Registration of the crio container factory successfully Sep 05 02:36:27.743317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742899 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 05 02:36:27.743317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742916 2577 factory.go:103] Registering Raw factory Sep 05 02:36:27.743317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.742929 2577 manager.go:1196] Started watching for new ooms in manager Sep 05 02:36:27.743544 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.743531 2577 manager.go:349] Starting recovery of all containers Sep 05 02:36:27.746358 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.746334 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcztg" Sep 05 02:36:27.750010 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.749986 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 05 02:36:27.750142 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.750124 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 05 02:36:27.752608 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.752558 2577 manager.go:354] Recovery completed Sep 05 02:36:27.753396 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.753374 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcztg" Sep 05 02:36:27.755422 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.755268 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 05 02:36:27.759232 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.759218 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.760801 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.760782 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.760851 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.760821 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.760851 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.760838 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.761367 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.761355 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 05 02:36:27.761367 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.761366 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 05 02:36:27.761458 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.761380 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 05 02:36:27.761458 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.761355 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.762056 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.762042 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.762125 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.762072 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.762125 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.762086 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.762593 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.762581 2577 policy_none.go:49] "None policy: Start" Sep 05 02:36:27.762683 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.762597 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 05 02:36:27.762683 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.762607 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 05 02:36:27.763343 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.763281 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-88.ec2.internal.18d24c33e358dd12 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-88.ec2.internal,UID:ip-10-0-136-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-88.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-88.ec2.internal,},FirstTimestamp:2026-09-05 02:36:27.76080309 +0000 UTC m=+0.376194084,LastTimestamp:2026-09-05 02:36:27.76080309 +0000 UTC m=+0.376194084,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-88.ec2.internal,}" Sep 05 02:36:27.763960 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.763949 2577 policy_none.go:47] "Start" Sep 05 02:36:27.803227 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803211 2577 manager.go:337] "Starting Device Plugin manager" Sep 05 02:36:27.803318 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.803246 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 05 02:36:27.803318 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803256 2577 server.go:87] "Starting device plugin registration server" Sep 05 02:36:27.803517 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803505 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 05 02:36:27.803554 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803521 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 05 02:36:27.803632 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803618 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 05 02:36:27.803754 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803742 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 05 02:36:27.803859 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.803847 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 05 02:36:27.804152 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.804132 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 05 02:36:27.804250 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.804185 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:27.861403 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.861368 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 05 02:36:27.862726 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.862712 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 05 02:36:27.862783 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.862762 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 05 02:36:27.862783 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.862782 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 05 02:36:27.862876 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.862822 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 05 02:36:27.865462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.865443 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:36:27.904591 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.904554 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.906226 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.906209 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.906306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.906242 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.906306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.906252 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.906306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.906273 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-88.ec2.internal" Sep 05 02:36:27.915105 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.915061 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-88.ec2.internal" Sep 05 02:36:27.915105 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.915084 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-88.ec2.internal\": node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:27.932461 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.932440 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:27.963439 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.963413 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal"] Sep 05 02:36:27.963524 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.963508 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.965043 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.965026 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.965123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.965054 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.965123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.965066 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.966422 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.966410 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.966528 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.966516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:27.966578 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.966551 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.967255 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.967241 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.967360 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.967270 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.967360 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.967282 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.968111 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.968095 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.968193 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.968120 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.968193 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.968134 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.969593 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.969580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" Sep 05 02:36:27.969685 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.969604 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:36:27.970353 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.970339 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:36:27.970445 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.970368 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:36:27.970445 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:27.970382 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:36:27.995260 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.995241 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-88.ec2.internal\" not found" node="ip-10-0-136-88.ec2.internal" Sep 05 02:36:27.999777 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:27.999762 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-88.ec2.internal\" not found" node="ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.033112 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.033096 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:28.133797 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.133770 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:28.144197 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.144177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/628c863f903577633a013c55bf0f4883-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal\" (UID: \"628c863f903577633a013c55bf0f4883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.144266 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.144200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/628c863f903577633a013c55bf0f4883-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal\" (UID: \"628c863f903577633a013c55bf0f4883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.144266 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.144225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad03ccc6109225d4db33f83dd3b0bcd2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-88.ec2.internal\" (UID: \"ad03ccc6109225d4db33f83dd3b0bcd2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.234116 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.234047 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:28.244432 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.244403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/628c863f903577633a013c55bf0f4883-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal\" (UID: \"628c863f903577633a013c55bf0f4883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.244432 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.244369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/628c863f903577633a013c55bf0f4883-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal\" (UID: \"628c863f903577633a013c55bf0f4883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.244557 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.244473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/628c863f903577633a013c55bf0f4883-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal\" (UID: \"628c863f903577633a013c55bf0f4883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.244557 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.244512 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/628c863f903577633a013c55bf0f4883-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal\" (UID: \"628c863f903577633a013c55bf0f4883\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.244557 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.244538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad03ccc6109225d4db33f83dd3b0bcd2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-88.ec2.internal\" (UID: \"ad03ccc6109225d4db33f83dd3b0bcd2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.244680 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.244566 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad03ccc6109225d4db33f83dd3b0bcd2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-88.ec2.internal\" (UID: \"ad03ccc6109225d4db33f83dd3b0bcd2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.298510 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.298480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.303439 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.303423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.335157 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.335028 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:28.435601 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.435574 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:28.536122 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.536065 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-88.ec2.internal\" not found" Sep 05 02:36:28.571749 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.571725 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:36:28.643075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.643054 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.655725 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.655710 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 05 02:36:28.657629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.657616 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" Sep 05 02:36:28.667143 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.667125 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 05 02:36:28.681300 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.681277 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 05 02:36:28.681425 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.681407 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 05 02:36:28.681474 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.681441 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 05 02:36:28.722679 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.722636 2577 apiserver.go:52] "Watching apiserver" Sep 05 02:36:28.734909 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.734888 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 05 02:36:28.737523 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.737500 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-c7g2g","openshift-ovn-kubernetes/ovnkube-node-bqljf","kube-system/global-pull-secret-syncer-hjwtk","kube-system/konnectivity-agent-gprhw","kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m","openshift-dns/node-resolver-g8k8p","openshift-image-registry/node-ca-dkz5p","openshift-multus/multus-k9x4q","openshift-network-diagnostics/network-check-target-2t4m9","openshift-cluster-node-tuning-operator/tuned-vktzt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal","openshift-multus/multus-additional-cni-plugins-m29bp","openshift-multus/network-metrics-daemon-jb25h"] Sep 05 02:36:28.738995 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.738976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.740755 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.740734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.740836 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.740822 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.740895 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.740868 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.741043 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.741028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tvh7f\"" Sep 05 02:36:28.745629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.743214 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.745629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.743225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.745629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.743587 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.745629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.743807 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k5fb2\"" Sep 05 02:36:28.745629 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.744182 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:28.745629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.744892 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 05 02:36:28.745956 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.745743 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.747054 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:28.747143 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.747099 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:28.747522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-kubernetes\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.747606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysctl-conf\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.747606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-sys\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.747606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-var-lib-kubelet\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.747771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c45887b-4b18-4283-a2e5-fb412443b413-hosts-file\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.747771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-run\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.747771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffe394e6-4404-4039-b7b7-a401c5ec2373-tmp\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.747771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9a9df36-ae83-4548-84f3-a1fa357ef62b-kubelet-config\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.747771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9a9df36-ae83-4548-84f3-a1fa357ef62b-dbus\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.747771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c45887b-4b18-4283-a2e5-fb412443b413-tmp-dir\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbwvq\" (UniqueName: \"kubernetes.io/projected/6c45887b-4b18-4283-a2e5-fb412443b413-kube-api-access-vbwvq\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-modprobe-d\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747815 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sx2d4\"" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-systemd\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-host\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-tuned\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysconfig\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysctl-d\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.747993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-lib-modules\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.748047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbcv6\" (UniqueName: \"kubernetes.io/projected/ffe394e6-4404-4039-b7b7-a401c5ec2373-kube-api-access-nbcv6\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.748323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.748075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.748323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.748233 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 05 02:36:28.748323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.748269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.749453 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.749436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.749844 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.749824 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 05 02:36:28.750181 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.750165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.750462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.750448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.750719 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.750699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.751038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.751021 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tlbnn\"" Sep 05 02:36:28.751321 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.751301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 05 02:36:28.751434 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.751420 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.751520 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.751499 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.751520 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.751500 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 05 02:36:28.752193 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.752174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.752607 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.752590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gh72q\"" Sep 05 02:36:28.753460 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.753448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:28.753552 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.753528 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:28.754407 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.754393 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 05 02:36:28.754858 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.754753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.754974 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.754951 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.755281 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755151 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 05 02:36:28.755281 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zzh8d\"" Sep 05 02:36:28.755281 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755244 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 05 02:36:28.755428 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755299 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 05 02:36:28.755428 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755405 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-04 02:31:28 +0000 UTC" deadline="2028-03-05 09:07:40.122755715 +0000 UTC" Sep 05 02:36:28.755500 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755428 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13134h31m11.367330658s" Sep 05 02:36:28.755500 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755449 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.755500 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755457 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 05 02:36:28.755619 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.755605 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fpzh5\"" Sep 05 02:36:28.756371 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.756355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.757139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.757121 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 05 02:36:28.757238 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.757221 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.757337 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.757322 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.757571 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.757403 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mlz5k\"" Sep 05 02:36:28.757571 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.757403 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 05 02:36:28.759450 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.758925 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 05 02:36:28.759450 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.758965 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2nwh2\"" Sep 05 02:36:28.759450 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.758980 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 05 02:36:28.759450 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.758932 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 05 02:36:28.762010 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.761996 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 05 02:36:28.802740 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:28.802720 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad03ccc6109225d4db33f83dd3b0bcd2.slice/crio-13f2eeca420ee4655607292cb3595c43e8342cd71711eaa53c6ac4aa88111e9c WatchSource:0}: Error finding container 13f2eeca420ee4655607292cb3595c43e8342cd71711eaa53c6ac4aa88111e9c: Status 404 returned error can't find the container with id 13f2eeca420ee4655607292cb3595c43e8342cd71711eaa53c6ac4aa88111e9c Sep 05 02:36:28.806892 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.806878 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:36:28.807850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.807835 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rp9zt" Sep 05 02:36:28.826337 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.826320 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rp9zt" Sep 05 02:36:28.843052 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.843034 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 05 02:36:28.848595 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:28.848680 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-system-cni-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.848680 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-run\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.848680 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.848778 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-cnibin\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.848778 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e795840-b0db-4357-ab60-dbbedb7d2d2e-host-slash\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.848839 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-run\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.848839 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbwvq\" (UniqueName: \"kubernetes.io/projected/6c45887b-4b18-4283-a2e5-fb412443b413-kube-api-access-vbwvq\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.848898 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-kubelet\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.848984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-cni-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.848984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-k8s-cni-cncf-io\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.848984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e795840-b0db-4357-ab60-dbbedb7d2d2e-iptables-alerter-script\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.848984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysconfig\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.848984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-lib-modules\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.848997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8md\" (UniqueName: \"kubernetes.io/projected/4232b83e-a36a-465b-aadf-9a248da4b831-kube-api-access-hl8md\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f-agent-certs\") pod \"konnectivity-agent-gprhw\" (UID: \"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f\") " pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-sys\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysconfig\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-run-netns\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-node-log\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849131 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-sys\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849137 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-lib-modules\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-cni-netd\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4232b83e-a36a-465b-aadf-9a248da4b831-cni-binary-copy\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-env-overrides\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f-konnectivity-ca\") pod \"konnectivity-agent-gprhw\" (UID: \"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f\") " pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffe394e6-4404-4039-b7b7-a401c5ec2373-tmp\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9a9df36-ae83-4548-84f3-a1fa357ef62b-dbus\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-etc-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovnkube-config\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-netns\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9a9df36-ae83-4548-84f3-a1fa357ef62b-dbus\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-tuned\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-socket-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849472 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-device-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-hostroot\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-conf-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.849572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4232b83e-a36a-465b-aadf-9a248da4b831-multus-daemon-config\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-multus-certs\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cnibin\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysctl-d\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89fh\" (UniqueName: \"kubernetes.io/projected/45163ac3-87c9-4121-a180-5fb3a6d3fced-kube-api-access-n89fh\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-var-lib-kubelet\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-systemd-units\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysctl-d\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-cni-bin\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-kubelet\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-var-lib-kubelet\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.849976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eecf568f-0bf5-41a6-95c9-506c30629fba-serviceca\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-registration-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.850335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c45887b-4b18-4283-a2e5-fb412443b413-tmp-dir\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-modprobe-d\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-systemd\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-systemd\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovn-node-metrics-cert\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850206 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-systemd\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-modprobe-d\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-cni-bin\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-cni-multus\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.850294 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-system-cni-dir\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2zzl\" (UniqueName: \"kubernetes.io/projected/4163c0ae-94fa-4920-bcff-8bd30ebc191d-kube-api-access-s2zzl\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.850356 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:29.350337847 +0000 UTC m=+1.965728837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-kubernetes\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-ovn\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.851145 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-log-socket\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-etc-kubernetes\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6x9t\" (UniqueName: \"kubernetes.io/projected/1e795840-b0db-4357-ab60-dbbedb7d2d2e-kube-api-access-g6x9t\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850484 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c45887b-4b18-4283-a2e5-fb412443b413-tmp-dir\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jftmn\" (UniqueName: \"kubernetes.io/projected/eecf568f-0bf5-41a6-95c9-506c30629fba-kube-api-access-jftmn\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c45887b-4b18-4283-a2e5-fb412443b413-hosts-file\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850550 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-kubernetes\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9a9df36-ae83-4548-84f3-a1fa357ef62b-kubelet-config\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-host\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c45887b-4b18-4283-a2e5-fb412443b413-hosts-file\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eecf568f-0bf5-41a6-95c9-506c30629fba-host\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbcv6\" (UniqueName: \"kubernetes.io/projected/ffe394e6-4404-4039-b7b7-a401c5ec2373-kube-api-access-nbcv6\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9a9df36-ae83-4548-84f3-a1fa357ef62b-kubelet-config\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-host\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-sys-fs\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.851629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovnkube-script-lib\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-socket-dir-parent\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cni-binary-copy\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.850996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysctl-conf\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.851019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2p4x\" (UniqueName: \"kubernetes.io/projected/854d055e-baf8-4237-8ae9-89a7fdb67e00-kube-api-access-k2p4x\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.851045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6h8\" (UniqueName: \"kubernetes.io/projected/6a1708e0-088c-44a4-b778-dd257d3b136d-kube-api-access-8x6h8\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.851064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-slash\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.851086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-var-lib-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.851098 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-sysctl-conf\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.852123 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.851107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.852850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.852833 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ffe394e6-4404-4039-b7b7-a401c5ec2373-etc-tuned\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.852902 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.852876 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffe394e6-4404-4039-b7b7-a401c5ec2373-tmp\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.865843 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.865797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" event={"ID":"ad03ccc6109225d4db33f83dd3b0bcd2","Type":"ContainerStarted","Data":"13f2eeca420ee4655607292cb3595c43e8342cd71711eaa53c6ac4aa88111e9c"} Sep 05 02:36:28.875852 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.875831 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbwvq\" (UniqueName: \"kubernetes.io/projected/6c45887b-4b18-4283-a2e5-fb412443b413-kube-api-access-vbwvq\") pod \"node-resolver-g8k8p\" (UID: \"6c45887b-4b18-4283-a2e5-fb412443b413\") " pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:28.876144 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.876128 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbcv6\" (UniqueName: \"kubernetes.io/projected/ffe394e6-4404-4039-b7b7-a401c5ec2373-kube-api-access-nbcv6\") pod \"tuned-vktzt\" (UID: \"ffe394e6-4404-4039-b7b7-a401c5ec2373\") " pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:28.951617 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-cni-netd\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.951617 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4232b83e-a36a-465b-aadf-9a248da4b831-cni-binary-copy\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-env-overrides\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f-konnectivity-ca\") pod \"konnectivity-agent-gprhw\" (UID: \"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f\") " pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-etc-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951699 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-cni-netd\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951768 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.951806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovnkube-config\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-netns\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951829 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-etc-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-socket-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-device-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-hostroot\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-conf-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4232b83e-a36a-465b-aadf-9a248da4b831-multus-daemon-config\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-multus-certs\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.951996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cnibin\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89fh\" (UniqueName: \"kubernetes.io/projected/45163ac3-87c9-4121-a180-5fb3a6d3fced-kube-api-access-n89fh\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-systemd-units\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-cni-bin\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-kubelet\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eecf568f-0bf5-41a6-95c9-506c30629fba-serviceca\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-device-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-registration-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-netns\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f-konnectivity-ca\") pod \"konnectivity-agent-gprhw\" (UID: \"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f\") " pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4232b83e-a36a-465b-aadf-9a248da4b831-cni-binary-copy\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-systemd\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952390 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-cni-bin\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovn-node-metrics-cert\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952427 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-env-overrides\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovnkube-config\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-cni-bin\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.952771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-cni-multus\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952524 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-registration-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952510 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-conf-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-system-cni-dir\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952546 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2zzl\" (UniqueName: \"kubernetes.io/projected/4163c0ae-94fa-4920-bcff-8bd30ebc191d-kube-api-access-s2zzl\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952566 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-system-cni-dir\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952510 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-socket-dir\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952569 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-systemd-units\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952595 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-hostroot\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952594 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-multus-certs\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952610 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952624 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-cni-bin\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-ovn\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-kubelet\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-log-socket\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-systemd\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.953522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952736 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4232b83e-a36a-465b-aadf-9a248da4b831-multus-daemon-config\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952794 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-var-lib-cni-multus\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952815 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-log-socket\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-ovn\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-etc-kubernetes\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952871 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-etc-kubernetes\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6x9t\" (UniqueName: \"kubernetes.io/projected/1e795840-b0db-4357-ab60-dbbedb7d2d2e-kube-api-access-g6x9t\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jftmn\" (UniqueName: \"kubernetes.io/projected/eecf568f-0bf5-41a6-95c9-506c30629fba-kube-api-access-jftmn\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952990 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cnibin\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.952993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eecf568f-0bf5-41a6-95c9-506c30629fba-host\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.953114 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953130 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eecf568f-0bf5-41a6-95c9-506c30629fba-host\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-sys-fs\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953201 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eecf568f-0bf5-41a6-95c9-506c30629fba-serviceca\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.953209 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:36:29.45319023 +0000 UTC m=+2.068581203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:28.954270 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953241 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-sys-fs\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953271 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovnkube-script-lib\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-socket-dir-parent\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cni-binary-copy\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2p4x\" (UniqueName: \"kubernetes.io/projected/854d055e-baf8-4237-8ae9-89a7fdb67e00-kube-api-access-k2p4x\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953433 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-socket-dir-parent\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6h8\" (UniqueName: \"kubernetes.io/projected/6a1708e0-088c-44a4-b778-dd257d3b136d-kube-api-access-8x6h8\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-slash\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-var-lib-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953575 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-var-lib-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-slash\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovnkube-script-lib\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-system-cni-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.954784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-run-openvswitch\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-system-cni-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-cnibin\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e795840-b0db-4357-ab60-dbbedb7d2d2e-host-slash\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953921 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-cnibin\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-kubelet\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-cni-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953963 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e795840-b0db-4357-ab60-dbbedb7d2d2e-host-slash\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.953982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-k8s-cni-cncf-io\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e795840-b0db-4357-ab60-dbbedb7d2d2e-iptables-alerter-script\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954021 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a1708e0-088c-44a4-b778-dd257d3b136d-etc-selinux\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-kubelet\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8md\" (UniqueName: \"kubernetes.io/projected/4232b83e-a36a-465b-aadf-9a248da4b831-kube-api-access-hl8md\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-multus-cni-dir\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4232b83e-a36a-465b-aadf-9a248da4b831-host-run-k8s-cni-cncf-io\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f-agent-certs\") pod \"konnectivity-agent-gprhw\" (UID: \"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f\") " pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-cni-binary-copy\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.955252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-run-netns\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-node-log\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4163c0ae-94fa-4920-bcff-8bd30ebc191d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:28.955767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-host-run-netns\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45163ac3-87c9-4121-a180-5fb3a6d3fced-node-log\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.955767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e795840-b0db-4357-ab60-dbbedb7d2d2e-iptables-alerter-script\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.955767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.954924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45163ac3-87c9-4121-a180-5fb3a6d3fced-ovn-node-metrics-cert\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.956219 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.956204 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f-agent-certs\") pod \"konnectivity-agent-gprhw\" (UID: \"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f\") " pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:28.970431 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.970416 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89fh\" (UniqueName: \"kubernetes.io/projected/45163ac3-87c9-4121-a180-5fb3a6d3fced-kube-api-access-n89fh\") pod \"ovnkube-node-bqljf\" (UID: \"45163ac3-87c9-4121-a180-5fb3a6d3fced\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:28.980742 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.980718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jftmn\" (UniqueName: \"kubernetes.io/projected/eecf568f-0bf5-41a6-95c9-506c30629fba-kube-api-access-jftmn\") pod \"node-ca-dkz5p\" (UID: \"eecf568f-0bf5-41a6-95c9-506c30629fba\") " pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:28.980742 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.980743 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:36:28.980907 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.980778 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:36:28.980907 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.980792 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:28.980907 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:28.980862 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:29.480846211 +0000 UTC m=+2.096237206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:28.981448 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.981430 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8md\" (UniqueName: \"kubernetes.io/projected/4232b83e-a36a-465b-aadf-9a248da4b831-kube-api-access-hl8md\") pod \"multus-k9x4q\" (UID: \"4232b83e-a36a-465b-aadf-9a248da4b831\") " pod="openshift-multus/multus-k9x4q" Sep 05 02:36:28.983654 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.983608 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6h8\" (UniqueName: \"kubernetes.io/projected/6a1708e0-088c-44a4-b778-dd257d3b136d-kube-api-access-8x6h8\") pod \"aws-ebs-csi-driver-node-pls8m\" (UID: \"6a1708e0-088c-44a4-b778-dd257d3b136d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:28.983754 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.983685 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2p4x\" (UniqueName: \"kubernetes.io/projected/854d055e-baf8-4237-8ae9-89a7fdb67e00-kube-api-access-k2p4x\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:28.984438 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.984416 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6x9t\" (UniqueName: \"kubernetes.io/projected/1e795840-b0db-4357-ab60-dbbedb7d2d2e-kube-api-access-g6x9t\") pod \"iptables-alerter-c7g2g\" (UID: \"1e795840-b0db-4357-ab60-dbbedb7d2d2e\") " pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:28.986780 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:28.986761 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2zzl\" (UniqueName: \"kubernetes.io/projected/4163c0ae-94fa-4920-bcff-8bd30ebc191d-kube-api-access-s2zzl\") pod \"multus-additional-cni-plugins-m29bp\" (UID: \"4163c0ae-94fa-4920-bcff-8bd30ebc191d\") " pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:29.002934 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.002915 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628c863f903577633a013c55bf0f4883.slice/crio-e6ac4b5e1d5dd211e019274b5dbb524f6e2ac6c467329e6a4bf1d97f25883447 WatchSource:0}: Error finding container e6ac4b5e1d5dd211e019274b5dbb524f6e2ac6c467329e6a4bf1d97f25883447: Status 404 returned error can't find the container with id e6ac4b5e1d5dd211e019274b5dbb524f6e2ac6c467329e6a4bf1d97f25883447 Sep 05 02:36:29.067347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.067331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g8k8p" Sep 05 02:36:29.072547 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.072524 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vktzt" Sep 05 02:36:29.075327 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.075305 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c45887b_4b18_4283_a2e5_fb412443b413.slice/crio-52920d641848f2d880e4da3a43c349ddd61bdcc7c7fa0aa7aab9aa613f104759 WatchSource:0}: Error finding container 52920d641848f2d880e4da3a43c349ddd61bdcc7c7fa0aa7aab9aa613f104759: Status 404 returned error can't find the container with id 52920d641848f2d880e4da3a43c349ddd61bdcc7c7fa0aa7aab9aa613f104759 Sep 05 02:36:29.078833 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.078812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:29.079437 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.079417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe394e6_4404_4039_b7b7_a401c5ec2373.slice/crio-d666bd4b54606c4ee9085efa46730f4ba5bf45d382d68be1484f25d6d6c34d16 WatchSource:0}: Error finding container d666bd4b54606c4ee9085efa46730f4ba5bf45d382d68be1484f25d6d6c34d16: Status 404 returned error can't find the container with id d666bd4b54606c4ee9085efa46730f4ba5bf45d382d68be1484f25d6d6c34d16 Sep 05 02:36:29.086361 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.086343 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7ef29c_44b5_4f90_b95e_c1f9e6360f2f.slice/crio-bd4920d38cb44c087e046c4ed9fc226f8f35e35625f98eb026820c17a0e63ae6 WatchSource:0}: Error finding container bd4920d38cb44c087e046c4ed9fc226f8f35e35625f98eb026820c17a0e63ae6: Status 404 returned error can't find the container with id bd4920d38cb44c087e046c4ed9fc226f8f35e35625f98eb026820c17a0e63ae6 Sep 05 02:36:29.102711 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.102693 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:36:29.107601 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.107587 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" Sep 05 02:36:29.113317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.113298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9x4q" Sep 05 02:36:29.114364 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.114345 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1708e0_088c_44a4_b778_dd257d3b136d.slice/crio-ee6beec04530e4d1aac47dd2777165e878ce27ebde9ccec41807e4049e863eb2 WatchSource:0}: Error finding container ee6beec04530e4d1aac47dd2777165e878ce27ebde9ccec41807e4049e863eb2: Status 404 returned error can't find the container with id ee6beec04530e4d1aac47dd2777165e878ce27ebde9ccec41807e4049e863eb2 Sep 05 02:36:29.119440 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.119418 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m29bp" Sep 05 02:36:29.120139 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.120121 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4232b83e_a36a_465b_aadf_9a248da4b831.slice/crio-3c34d8289c03198b91c4d7259e2e8becfde531a1ca84a8a4ea6c86d4a270d527 WatchSource:0}: Error finding container 3c34d8289c03198b91c4d7259e2e8becfde531a1ca84a8a4ea6c86d4a270d527: Status 404 returned error can't find the container with id 3c34d8289c03198b91c4d7259e2e8becfde531a1ca84a8a4ea6c86d4a270d527 Sep 05 02:36:29.125898 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.125879 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4163c0ae_94fa_4920_bcff_8bd30ebc191d.slice/crio-0646759b6ca6b22b521c1278d8a972d5bb5688548e5fbdbbec5b488f47b1065f WatchSource:0}: Error finding container 0646759b6ca6b22b521c1278d8a972d5bb5688548e5fbdbbec5b488f47b1065f: Status 404 returned error can't find the container with id 0646759b6ca6b22b521c1278d8a972d5bb5688548e5fbdbbec5b488f47b1065f Sep 05 02:36:29.127038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.126976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:29.132419 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.132405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c7g2g" Sep 05 02:36:29.134449 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.134291 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45163ac3_87c9_4121_a180_5fb3a6d3fced.slice/crio-e58872e6ae96cb09897ec9254feb722c21baeea49088e7f14adf1d4408dc7e43 WatchSource:0}: Error finding container e58872e6ae96cb09897ec9254feb722c21baeea49088e7f14adf1d4408dc7e43: Status 404 returned error can't find the container with id e58872e6ae96cb09897ec9254feb722c21baeea49088e7f14adf1d4408dc7e43 Sep 05 02:36:29.136661 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.136626 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dkz5p" Sep 05 02:36:29.139545 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.139530 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e795840_b0db_4357_ab60_dbbedb7d2d2e.slice/crio-d4c9d0b532d9dbf02681869843392cf82e028f801e72a849ff59126174e18f11 WatchSource:0}: Error finding container d4c9d0b532d9dbf02681869843392cf82e028f801e72a849ff59126174e18f11: Status 404 returned error can't find the container with id d4c9d0b532d9dbf02681869843392cf82e028f801e72a849ff59126174e18f11 Sep 05 02:36:29.143975 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:36:29.143958 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecf568f_0bf5_41a6_95c9_506c30629fba.slice/crio-363319b61a1c3d1449133d72fda471e62c7d46f8a47661828d3640a63dbd8164 WatchSource:0}: Error finding container 363319b61a1c3d1449133d72fda471e62c7d46f8a47661828d3640a63dbd8164: Status 404 returned error can't find the container with id 363319b61a1c3d1449133d72fda471e62c7d46f8a47661828d3640a63dbd8164 Sep 05 02:36:29.326096 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.326024 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:36:29.356172 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.356145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:29.356288 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.356268 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:29.356337 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.356317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:30.356303947 +0000 UTC m=+2.971694937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:29.457013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.456989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:29.457158 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.457097 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:29.457158 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.457144 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:36:30.457132004 +0000 UTC m=+3.072522995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:29.557858 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.557830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:29.558026 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.558009 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:36:29.558115 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.558033 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:36:29.558115 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.558046 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:29.558115 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:29.558105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:30.558084005 +0000 UTC m=+3.173474985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:29.828637 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.828588 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 02:31:29 +0000 UTC" deadline="2028-04-26 11:36:51.234766656 +0000 UTC" Sep 05 02:36:29.829576 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.828646 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14385h0m21.406136934s" Sep 05 02:36:29.830845 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.830819 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:36:29.871522 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.871483 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerStarted","Data":"0646759b6ca6b22b521c1278d8a972d5bb5688548e5fbdbbec5b488f47b1065f"} Sep 05 02:36:29.889698 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.889655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" event={"ID":"6a1708e0-088c-44a4-b778-dd257d3b136d","Type":"ContainerStarted","Data":"ee6beec04530e4d1aac47dd2777165e878ce27ebde9ccec41807e4049e863eb2"} Sep 05 02:36:29.901547 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.901513 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gprhw" event={"ID":"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f","Type":"ContainerStarted","Data":"bd4920d38cb44c087e046c4ed9fc226f8f35e35625f98eb026820c17a0e63ae6"} Sep 05 02:36:29.903899 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.903841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g8k8p" event={"ID":"6c45887b-4b18-4283-a2e5-fb412443b413","Type":"ContainerStarted","Data":"52920d641848f2d880e4da3a43c349ddd61bdcc7c7fa0aa7aab9aa613f104759"} Sep 05 02:36:29.910157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.910131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c7g2g" event={"ID":"1e795840-b0db-4357-ab60-dbbedb7d2d2e","Type":"ContainerStarted","Data":"d4c9d0b532d9dbf02681869843392cf82e028f801e72a849ff59126174e18f11"} Sep 05 02:36:29.914252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.914221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9x4q" event={"ID":"4232b83e-a36a-465b-aadf-9a248da4b831","Type":"ContainerStarted","Data":"3c34d8289c03198b91c4d7259e2e8becfde531a1ca84a8a4ea6c86d4a270d527"} Sep 05 02:36:29.917182 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.917151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vktzt" event={"ID":"ffe394e6-4404-4039-b7b7-a401c5ec2373","Type":"ContainerStarted","Data":"d666bd4b54606c4ee9085efa46730f4ba5bf45d382d68be1484f25d6d6c34d16"} Sep 05 02:36:29.925105 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.925079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" event={"ID":"628c863f903577633a013c55bf0f4883","Type":"ContainerStarted","Data":"e6ac4b5e1d5dd211e019274b5dbb524f6e2ac6c467329e6a4bf1d97f25883447"} Sep 05 02:36:29.926827 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.926797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dkz5p" event={"ID":"eecf568f-0bf5-41a6-95c9-506c30629fba","Type":"ContainerStarted","Data":"363319b61a1c3d1449133d72fda471e62c7d46f8a47661828d3640a63dbd8164"} Sep 05 02:36:29.931903 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:29.931876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"e58872e6ae96cb09897ec9254feb722c21baeea49088e7f14adf1d4408dc7e43"} Sep 05 02:36:30.347462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.347430 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:36:30.364960 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.364923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:30.365173 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.365154 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:30.365270 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.365224 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:32.365205875 +0000 UTC m=+4.980596854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:30.466340 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.466235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:30.466543 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.466419 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:30.466543 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.466502 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:36:32.466479363 +0000 UTC m=+5.081870358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:30.567335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.567295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:30.567536 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.567471 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:36:30.567536 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.567492 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:36:30.567536 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.567505 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:30.567700 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.567564 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:32.567545392 +0000 UTC m=+5.182936382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:30.829025 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.828916 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 02:31:29 +0000 UTC" deadline="2028-02-05 23:12:40.332111111 +0000 UTC" Sep 05 02:36:30.829025 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.828985 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12452h36m9.503132133s" Sep 05 02:36:30.863617 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.863512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:30.863617 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.863541 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:30.863869 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.863650 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:30.864157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:30.863999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:30.864157 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.864109 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:30.864309 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:30.864212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:32.386016 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:32.385871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:32.386614 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.386064 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:32.386614 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.386127 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:36.386106534 +0000 UTC m=+9.001497510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:32.486589 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:32.486552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:32.486793 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.486766 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:32.486870 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.486836 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:36:36.486814257 +0000 UTC m=+9.102205251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:32.588045 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:32.587999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:32.588250 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.588195 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:36:32.588250 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.588219 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:36:32.588250 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.588231 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:32.588422 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.588292 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:36.588273001 +0000 UTC m=+9.203663987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:32.863755 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:32.863688 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:32.863951 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.863840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:32.864349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:32.864327 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:32.864508 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.864485 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:32.864639 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:32.864573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:32.864750 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:32.864656 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:34.863115 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:34.863078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:34.863606 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:34.863229 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:34.863606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:34.863312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:34.863606 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:34.863389 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:34.863606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:34.863447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:34.863606 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:34.863495 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:36.423369 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:36.423328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:36.423695 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.423487 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:36.423695 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.423558 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:44.423537922 +0000 UTC m=+17.038928902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:36.524113 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:36.524078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:36.524301 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.524203 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:36.524301 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.524264 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:36:44.524249145 +0000 UTC m=+17.139640120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:36.625516 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:36.625473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:36.625730 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.625691 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:36:36.625730 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.625725 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:36:36.625884 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.625740 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:36.625884 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.625807 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:36:44.625786612 +0000 UTC m=+17.241177608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:36.864428 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:36.864391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:36.864616 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.864522 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:36.864943 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:36.864922 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:36.865079 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.865033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:36.865151 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:36.865094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:36.865215 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:36.865173 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:38.863759 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:38.863174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:38.863759 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:38.863198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:38.863759 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:38.863215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:38.863759 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:38.863313 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:38.863759 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:38.863418 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:38.863759 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:38.863542 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:40.863356 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:40.863326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:40.863825 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:40.863325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:40.863825 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:40.863457 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:40.863825 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:40.863325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:40.863825 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:40.863521 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:40.863825 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:40.863575 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:42.863961 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:42.863921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:42.864399 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:42.863932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:42.864399 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:42.864054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:42.864399 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:42.863944 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:42.864399 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:42.864124 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:42.864399 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:42.864218 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:44.487152 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:44.487116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:44.487609 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.487280 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:44.487609 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.487359 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:37:00.487337724 +0000 UTC m=+33.102728714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:36:44.588018 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:44.587988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:44.588188 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.588160 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:44.588246 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.588235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:00.588219106 +0000 UTC m=+33.203610103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:36:44.688852 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:44.688817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:44.689043 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.688961 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:36:44.689043 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.688984 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:36:44.689043 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.688993 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:44.689179 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.689047 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:37:00.689032229 +0000 UTC m=+33.304423207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:36:44.863947 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:44.863913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:44.863947 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:44.863936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:44.864287 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:44.863939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:44.864287 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.864037 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:44.864287 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.864116 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:44.864287 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:44.864220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:46.864094 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:46.863936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:46.864094 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:46.864045 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:46.864094 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:46.864065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:46.864596 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:46.864176 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:46.864596 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:46.864249 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:46.864596 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:46.864349 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:48.863792 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:48.863754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:48.863792 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:48.863777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:48.864291 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:48.863892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:48.864291 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:48.863949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:48.864291 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:48.864008 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:48.864291 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:48.863899 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:50.001875 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.001521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" event={"ID":"ad03ccc6109225d4db33f83dd3b0bcd2","Type":"ContainerStarted","Data":"e6d07f0535e0d6ccde51cfaac4eaf29b5220dddcb4d529063ff5e94191f9db89"} Sep 05 02:36:50.003382 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.003357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dkz5p" event={"ID":"eecf568f-0bf5-41a6-95c9-506c30629fba","Type":"ContainerStarted","Data":"e6f04a9661a9c2d6b4a762fa3961ebc6a04d77fde8917e703f855bde1b74d060"} Sep 05 02:36:50.006226 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.006203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"e3260ad9ee8c678b386a9ccf1784703dfdd3cb09f92485482a88f0394bf1d93c"} Sep 05 02:36:50.006328 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.006282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"25d8e1bbd2200de123652ee5f2367a93b4d2ffa8ac7a9e465f6dac9116ef0d1e"} Sep 05 02:36:50.006385 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.006332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"af3b7417f6ff36891cdaddf43e5d57f075a8cba8b23c70ea50a4cdf2657cc465"} Sep 05 02:36:50.006435 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.006382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"8d9e03aaae10183b2863bb6b56f9cde841e63c1d130bc9143339b4f238c2bf7e"} Sep 05 02:36:50.007954 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.007931 2577 generic.go:356] "Generic (PLEG): container finished" podID="4163c0ae-94fa-4920-bcff-8bd30ebc191d" containerID="1754fcb16f9fd78697bee79b3d7c3c76ea5afc98c7e7d31a36e1b2075898fa9d" exitCode=0 Sep 05 02:36:50.008059 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.008006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerDied","Data":"1754fcb16f9fd78697bee79b3d7c3c76ea5afc98c7e7d31a36e1b2075898fa9d"} Sep 05 02:36:50.009680 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.009637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" event={"ID":"6a1708e0-088c-44a4-b778-dd257d3b136d","Type":"ContainerStarted","Data":"c6a6f821ceeaeab5e2dd5983a495ea6b1bef3012571e5a77f15b5b04cda19fc2"} Sep 05 02:36:50.011086 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.011036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gprhw" event={"ID":"ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f","Type":"ContainerStarted","Data":"31e0f4815f644d67c75fbf750a1650d68f027da53317e5b0e7f03f92e2c4c628"} Sep 05 02:36:50.012658 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.012614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g8k8p" event={"ID":"6c45887b-4b18-4283-a2e5-fb412443b413","Type":"ContainerStarted","Data":"9769d82f1173ad6c470e4fca962014f1bf94e322ab0bcff54c59774fad59adda"} Sep 05 02:36:50.014061 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.014042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9x4q" event={"ID":"4232b83e-a36a-465b-aadf-9a248da4b831","Type":"ContainerStarted","Data":"d70050a8416bf3995f4ad9c6c206d3e15fc558f9b8acba78b204bc425f0a4eec"} Sep 05 02:36:50.015467 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.015447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vktzt" event={"ID":"ffe394e6-4404-4039-b7b7-a401c5ec2373","Type":"ContainerStarted","Data":"84793f252b470af7d9462fb9dd9af91b581d38631432bb48eaa53112f8c50190"} Sep 05 02:36:50.017100 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.017075 2577 generic.go:356] "Generic (PLEG): container finished" podID="628c863f903577633a013c55bf0f4883" containerID="7e212962caec6b0abb91f2c5d9cae6b3d9ddbd187bbdfd854850a5319e5a2f37" exitCode=0 Sep 05 02:36:50.017100 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.017101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" event={"ID":"628c863f903577633a013c55bf0f4883","Type":"ContainerDied","Data":"7e212962caec6b0abb91f2c5d9cae6b3d9ddbd187bbdfd854850a5319e5a2f37"} Sep 05 02:36:50.017334 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.017287 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-88.ec2.internal" podStartSLOduration=21.017273656 podStartE2EDuration="21.017273656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:50.01657568 +0000 UTC m=+22.631966676" watchObservedRunningTime="2026-09-05 02:36:50.017273656 +0000 UTC m=+22.632664692" Sep 05 02:36:50.030430 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.030389 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vktzt" podStartSLOduration=1.707517204 podStartE2EDuration="22.030371604s" totalImagesPullingTime="20.3228544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:50.030126265 +0000 UTC m=+22.645517261" watchObservedRunningTime="2026-09-05 02:36:50.030371604 +0000 UTC m=+22.645762601" Sep 05 02:36:50.062704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.061502 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g8k8p" podStartSLOduration=1.742960435 podStartE2EDuration="22.061483711s" totalImagesPullingTime="20.318523276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:50.060449195 +0000 UTC m=+22.675840192" watchObservedRunningTime="2026-09-05 02:36:50.061483711 +0000 UTC m=+22.676874710" Sep 05 02:36:50.088250 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.088187 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gprhw" podStartSLOduration=9.352539709 podStartE2EDuration="22.088173844s" totalImagesPullingTime="12.735634135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:50.073918753 +0000 UTC m=+22.689309749" watchObservedRunningTime="2026-09-05 02:36:50.088173844 +0000 UTC m=+22.703564840" Sep 05 02:36:50.088444 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.088404 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k9x4q" podStartSLOduration=1.77057094 podStartE2EDuration="22.088397214s" totalImagesPullingTime="20.317826274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:50.087991478 +0000 UTC m=+22.703382473" watchObservedRunningTime="2026-09-05 02:36:50.088397214 +0000 UTC m=+22.703788210" Sep 05 02:36:50.863755 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.863726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:50.863876 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.863763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:50.863876 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:50.863816 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:50.863876 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:50.863826 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:50.863985 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:50.863892 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:50.863985 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:50.863943 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:51.023365 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.023293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"49956c822087f2ec6053f5b0051dc3467e07da85a3d6ed80d52ff62574dfc824"} Sep 05 02:36:51.023365 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.023372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"2a943e2585651c4dc15c1a83d4580bad7f0fe342b79b97d16ac13e328281f7b1"} Sep 05 02:36:51.025084 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.025041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c7g2g" event={"ID":"1e795840-b0db-4357-ab60-dbbedb7d2d2e","Type":"ContainerStarted","Data":"1a63d7abff01e2f4f9eda90e38d5ea1a87c5c7f82b4e87c7ee29b931f8198ba8"} Sep 05 02:36:51.039832 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.039788 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dkz5p" podStartSLOduration=2.804950342 podStartE2EDuration="23.039775125s" totalImagesPullingTime="20.234824783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:50.10012381 +0000 UTC m=+22.715514806" watchObservedRunningTime="2026-09-05 02:36:51.039775125 +0000 UTC m=+23.655166121" Sep 05 02:36:51.040201 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.040170 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c7g2g" podStartSLOduration=2.799688368 podStartE2EDuration="23.040161665s" totalImagesPullingTime="20.240473297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:51.039758372 +0000 UTC m=+23.655149369" watchObservedRunningTime="2026-09-05 02:36:51.040161665 +0000 UTC m=+23.655552662" Sep 05 02:36:51.221558 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.221351 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 05 02:36:51.824347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.824220 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-05T02:36:51.221553997Z","UUID":"7c6a0d2c-7d52-4391-a569-e39b6e92893f","Handler":null,"Name":"","Endpoint":""} Sep 05 02:36:51.827138 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.827049 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 05 02:36:51.827138 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:51.827084 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 05 02:36:52.030422 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:52.030381 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" event={"ID":"6a1708e0-088c-44a4-b778-dd257d3b136d","Type":"ContainerStarted","Data":"840c8b98dbba607ebe92648bb5fbcd5170c086356f2d93006da9bf729f88578d"} Sep 05 02:36:52.032712 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:52.032681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" event={"ID":"628c863f903577633a013c55bf0f4883","Type":"ContainerStarted","Data":"f78444d909e670369b900054b49819d89fe665bea7f152249de74c0deceb3b8b"} Sep 05 02:36:52.864473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:52.864016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:52.864473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:52.864051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:52.864473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:52.864020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:52.864473 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:52.864129 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:52.864473 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:52.864203 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:52.864473 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:52.864261 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:53.037719 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:53.037679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"cf7ecf20c670cd7e04030065ab26768d5141f1315ba1f9712a2f84a64885d03a"} Sep 05 02:36:53.039716 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:53.039691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" event={"ID":"6a1708e0-088c-44a4-b778-dd257d3b136d","Type":"ContainerStarted","Data":"790be807baf0011deb8563389cd1d5384fa5c9533cf7fa865f4d52ca87f3da77"} Sep 05 02:36:53.058138 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:53.058095 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pls8m" podStartSLOduration=2.473410362 podStartE2EDuration="25.058080397s" totalImagesPullingTime="22.584670035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:53.05791257 +0000 UTC m=+25.673303566" watchObservedRunningTime="2026-09-05 02:36:53.058080397 +0000 UTC m=+25.673471392" Sep 05 02:36:53.058388 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:53.058368 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-88.ec2.internal" podStartSLOduration=24.058360646 podStartE2EDuration="24.058360646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:52.056050328 +0000 UTC m=+24.671441326" watchObservedRunningTime="2026-09-05 02:36:53.058360646 +0000 UTC m=+25.673751642" Sep 05 02:36:54.118997 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:54.118959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:54.119744 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:54.119711 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:54.863916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:54.863886 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:54.864027 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:54.863936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:54.864027 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:54.863938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:54.864139 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:54.864017 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:54.864184 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:54.864132 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:54.864238 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:54.864222 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:55.048427 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.048213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" event={"ID":"45163ac3-87c9-4121-a180-5fb3a6d3fced","Type":"ContainerStarted","Data":"345531ac30ad6365d745f1431705d1a3a0c8cf45d024fe1d51130f84d74d9e8a"} Sep 05 02:36:55.048548 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.048532 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:55.048655 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.048588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:55.050346 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.050321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerStarted","Data":"af59131475545f3b000544626590aa75bd71d633eb95487724e002b7a5a98506"} Sep 05 02:36:55.050552 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.050534 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:55.051106 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.051078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gprhw" Sep 05 02:36:55.063602 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.063584 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:55.072612 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:55.072573 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" podStartSLOduration=6.772199254 podStartE2EDuration="27.072561272s" totalImagesPullingTime="20.300362018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:36:55.072401279 +0000 UTC m=+27.687792278" watchObservedRunningTime="2026-09-05 02:36:55.072561272 +0000 UTC m=+27.687952281" Sep 05 02:36:56.056138 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.055592 2577 generic.go:356] "Generic (PLEG): container finished" podID="4163c0ae-94fa-4920-bcff-8bd30ebc191d" containerID="af59131475545f3b000544626590aa75bd71d633eb95487724e002b7a5a98506" exitCode=0 Sep 05 02:36:56.056138 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.055745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerDied","Data":"af59131475545f3b000544626590aa75bd71d633eb95487724e002b7a5a98506"} Sep 05 02:36:56.057087 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.056981 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:56.078235 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.078213 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:36:56.652323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.652266 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjwtk"] Sep 05 02:36:56.652467 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.652430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:56.652584 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:56.652556 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:56.653096 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.653073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2t4m9"] Sep 05 02:36:56.653194 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.653181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:56.653306 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:56.653288 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:56.653744 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.653720 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jb25h"] Sep 05 02:36:56.653829 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:56.653817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:56.653915 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:56.653897 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:58.863979 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:58.863948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:36:58.863979 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:58.863980 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:36:58.864555 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:58.864073 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:36:58.864555 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:58.864123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:36:58.864555 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:58.864212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:36:58.864555 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:36:58.864284 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:36:59.064887 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:59.064854 2577 generic.go:356] "Generic (PLEG): container finished" podID="4163c0ae-94fa-4920-bcff-8bd30ebc191d" containerID="3286ff65e396599a016937b7cd7de8e6e1a67b3699a06eacb181fcea2bab23cb" exitCode=0 Sep 05 02:36:59.065033 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:36:59.064905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerDied","Data":"3286ff65e396599a016937b7cd7de8e6e1a67b3699a06eacb181fcea2bab23cb"} Sep 05 02:37:00.506477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:00.506393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:37:00.506896 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.506564 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:37:00.506896 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.506667 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret podName:d9a9df36-ae83-4548-84f3-a1fa357ef62b nodeName:}" failed. No retries permitted until 2026-09-05 02:37:32.506625094 +0000 UTC m=+65.122016087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret") pod "global-pull-secret-syncer-hjwtk" (UID: "d9a9df36-ae83-4548-84f3-a1fa357ef62b") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:37:00.607088 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:00.607061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:37:00.607226 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.607203 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:37:00.607278 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.607256 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs podName:854d055e-baf8-4237-8ae9-89a7fdb67e00 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:32.607241957 +0000 UTC m=+65.222632935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs") pod "network-metrics-daemon-jb25h" (UID: "854d055e-baf8-4237-8ae9-89a7fdb67e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:37:00.707752 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:00.707727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:00.707884 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.707852 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:37:00.707884 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.707867 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:37:00.707945 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.707888 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7xj2c for pod openshift-network-diagnostics/network-check-target-2t4m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:37:00.707945 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.707935 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c podName:9b79a834-3270-4b5e-902e-d03953fc571b nodeName:}" failed. No retries permitted until 2026-09-05 02:37:32.70791891 +0000 UTC m=+65.323309884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7xj2c" (UniqueName: "kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c") pod "network-check-target-2t4m9" (UID: "9b79a834-3270-4b5e-902e-d03953fc571b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:37:00.863113 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:00.863082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:00.863113 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:00.863118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:37:00.863288 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.863198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2t4m9" podUID="9b79a834-3270-4b5e-902e-d03953fc571b" Sep 05 02:37:00.863288 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:00.863251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:37:00.863363 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.863344 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjwtk" podUID="d9a9df36-ae83-4548-84f3-a1fa357ef62b" Sep 05 02:37:00.863430 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:00.863418 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jb25h" podUID="854d055e-baf8-4237-8ae9-89a7fdb67e00" Sep 05 02:37:01.071877 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:01.071843 2577 generic.go:356] "Generic (PLEG): container finished" podID="4163c0ae-94fa-4920-bcff-8bd30ebc191d" containerID="a60951851da44a7d9303e80ce5a8342e49b3ab542d98fffe1cbf612229b6801c" exitCode=0 Sep 05 02:37:01.072009 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:01.071897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerDied","Data":"a60951851da44a7d9303e80ce5a8342e49b3ab542d98fffe1cbf612229b6801c"} Sep 05 02:37:01.581596 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:01.581548 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:01.732452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:01.732416 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:02.147527 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.147503 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-88.ec2.internal" event="NodeReady" Sep 05 02:37:02.147690 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.147654 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 05 02:37:02.188980 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.188897 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9dcb6b888-24mhq"] Sep 05 02:37:02.210752 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.210721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.215218 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.214967 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5mmzg\"" Sep 05 02:37:02.215218 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.215014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 05 02:37:02.215218 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.215051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 05 02:37:02.215477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.215459 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lz7cq"] Sep 05 02:37:02.217951 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.217792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 05 02:37:02.222928 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.222910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 05 02:37:02.240056 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.240021 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sqksf"] Sep 05 02:37:02.240196 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.240072 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.243855 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.243833 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 05 02:37:02.244030 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.244011 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 05 02:37:02.244176 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.244160 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-njhk9\"" Sep 05 02:37:02.255257 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.255234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9dcb6b888-24mhq"] Sep 05 02:37:02.255380 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.255274 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lz7cq"] Sep 05 02:37:02.255380 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.255300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sqksf"] Sep 05 02:37:02.255380 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.255349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.258030 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.258011 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 05 02:37:02.258315 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.258294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 05 02:37:02.258466 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.258412 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 05 02:37:02.258771 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.258757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wcdvh\"" Sep 05 02:37:02.318521 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdphg\" (UniqueName: \"kubernetes.io/projected/90ee08cf-b316-4875-a01b-6ec1210b9a6a-kube-api-access-bdphg\") pod \"ingress-canary-sqksf\" (UID: \"90ee08cf-b316-4875-a01b-6ec1210b9a6a\") " pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.318521 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5jws\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-kube-api-access-c5jws\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/180b4dbf-ae7a-4848-95af-c708e48e2c59-tmp-dir\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-bound-sa-token\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbdf\" (UniqueName: \"kubernetes.io/projected/180b4dbf-ae7a-4848-95af-c708e48e2c59-kube-api-access-pxbdf\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-certificates\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-installation-pull-secrets\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90ee08cf-b316-4875-a01b-6ec1210b9a6a-cert\") pod \"ingress-canary-sqksf\" (UID: \"90ee08cf-b316-4875-a01b-6ec1210b9a6a\") " pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.318842 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1818648a-354a-43a7-8bd1-11a3ad76ed75-ca-trust-extracted\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.319317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-trusted-ca\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.319317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-image-registry-private-configuration\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.319317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.318934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/180b4dbf-ae7a-4848-95af-c708e48e2c59-config-volume\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.419971 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.419937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.420164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-certificates\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-installation-pull-secrets\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90ee08cf-b316-4875-a01b-6ec1210b9a6a-cert\") pod \"ingress-canary-sqksf\" (UID: \"90ee08cf-b316-4875-a01b-6ec1210b9a6a\") " pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.420164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1818648a-354a-43a7-8bd1-11a3ad76ed75-ca-trust-extracted\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-trusted-ca\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-image-registry-private-configuration\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/180b4dbf-ae7a-4848-95af-c708e48e2c59-config-volume\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdphg\" (UniqueName: \"kubernetes.io/projected/90ee08cf-b316-4875-a01b-6ec1210b9a6a-kube-api-access-bdphg\") pod \"ingress-canary-sqksf\" (UID: \"90ee08cf-b316-4875-a01b-6ec1210b9a6a\") " pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5jws\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-kube-api-access-c5jws\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/180b4dbf-ae7a-4848-95af-c708e48e2c59-tmp-dir\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.420404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-bound-sa-token\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.420714 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.420410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbdf\" (UniqueName: \"kubernetes.io/projected/180b4dbf-ae7a-4848-95af-c708e48e2c59-kube-api-access-pxbdf\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.421847 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.421817 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/180b4dbf-ae7a-4848-95af-c708e48e2c59-tmp-dir\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.422028 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.422008 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:37:02.422100 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.422032 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dcb6b888-24mhq: secret "image-registry-tls" not found Sep 05 02:37:02.422159 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.422103 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls podName:1818648a-354a-43a7-8bd1-11a3ad76ed75 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:02.922081966 +0000 UTC m=+35.537472962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls") pod "image-registry-9dcb6b888-24mhq" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75") : secret "image-registry-tls" not found Sep 05 02:37:02.422227 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.422207 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1818648a-354a-43a7-8bd1-11a3ad76ed75-ca-trust-extracted\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.422336 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.422316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-certificates\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.422547 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.422528 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:37:02.422691 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.422589 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls podName:180b4dbf-ae7a-4848-95af-c708e48e2c59 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:02.922572747 +0000 UTC m=+35.537963735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls") pod "dns-default-lz7cq" (UID: "180b4dbf-ae7a-4848-95af-c708e48e2c59") : secret "dns-default-metrics-tls" not found Sep 05 02:37:02.423542 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.423519 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/180b4dbf-ae7a-4848-95af-c708e48e2c59-config-volume\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.425996 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.424064 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-trusted-ca\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.426808 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.426789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-image-registry-private-configuration\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.426808 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.426797 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90ee08cf-b316-4875-a01b-6ec1210b9a6a-cert\") pod \"ingress-canary-sqksf\" (UID: \"90ee08cf-b316-4875-a01b-6ec1210b9a6a\") " pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.427747 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.427728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-installation-pull-secrets\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.439029 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.438943 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5jws\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-kube-api-access-c5jws\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.439272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.439246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-bound-sa-token\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.439340 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.439270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbdf\" (UniqueName: \"kubernetes.io/projected/180b4dbf-ae7a-4848-95af-c708e48e2c59-kube-api-access-pxbdf\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.440082 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.440061 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdphg\" (UniqueName: \"kubernetes.io/projected/90ee08cf-b316-4875-a01b-6ec1210b9a6a-kube-api-access-bdphg\") pod \"ingress-canary-sqksf\" (UID: \"90ee08cf-b316-4875-a01b-6ec1210b9a6a\") " pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.565789 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.565754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sqksf" Sep 05 02:37:02.863489 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.863283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:02.863941 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.863343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:37:02.863941 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.863371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:37:02.866093 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.866069 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 05 02:37:02.866209 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.866100 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 05 02:37:02.866209 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.866116 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2szj7\"" Sep 05 02:37:02.866209 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.866073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 05 02:37:02.866538 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.866519 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 05 02:37:02.866688 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.866548 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vkq8d\"" Sep 05 02:37:02.898425 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.898396 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sqksf"] Sep 05 02:37:02.902185 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:02.902161 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ee08cf_b316_4875_a01b_6ec1210b9a6a.slice/crio-bd54b6c663fe026aebb5d380f9a974d506692772b80f7351b3684a6b67b39abd WatchSource:0}: Error finding container bd54b6c663fe026aebb5d380f9a974d506692772b80f7351b3684a6b67b39abd: Status 404 returned error can't find the container with id bd54b6c663fe026aebb5d380f9a974d506692772b80f7351b3684a6b67b39abd Sep 05 02:37:02.925225 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.925195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:02.925379 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:02.925258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:02.925379 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.925372 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:37:02.925501 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.925373 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:37:02.925501 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.925398 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dcb6b888-24mhq: secret "image-registry-tls" not found Sep 05 02:37:02.925501 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.925421 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls podName:180b4dbf-ae7a-4848-95af-c708e48e2c59 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:03.925408094 +0000 UTC m=+36.540799068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls") pod "dns-default-lz7cq" (UID: "180b4dbf-ae7a-4848-95af-c708e48e2c59") : secret "dns-default-metrics-tls" not found Sep 05 02:37:02.925501 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:02.925454 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls podName:1818648a-354a-43a7-8bd1-11a3ad76ed75 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:03.925434999 +0000 UTC m=+36.540825976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls") pod "image-registry-9dcb6b888-24mhq" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75") : secret "image-registry-tls" not found Sep 05 02:37:03.078969 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:03.078929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sqksf" event={"ID":"90ee08cf-b316-4875-a01b-6ec1210b9a6a","Type":"ContainerStarted","Data":"bd54b6c663fe026aebb5d380f9a974d506692772b80f7351b3684a6b67b39abd"} Sep 05 02:37:03.933633 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:03.933600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:03.934223 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:03.933675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:03.934223 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:03.933796 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:37:03.934223 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:03.933815 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:37:03.934223 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:03.933819 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dcb6b888-24mhq: secret "image-registry-tls" not found Sep 05 02:37:03.934223 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:03.933883 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls podName:180b4dbf-ae7a-4848-95af-c708e48e2c59 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:05.933862178 +0000 UTC m=+38.549253165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls") pod "dns-default-lz7cq" (UID: "180b4dbf-ae7a-4848-95af-c708e48e2c59") : secret "dns-default-metrics-tls" not found Sep 05 02:37:03.934223 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:03.933903 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls podName:1818648a-354a-43a7-8bd1-11a3ad76ed75 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:05.933894065 +0000 UTC m=+38.549285042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls") pod "image-registry-9dcb6b888-24mhq" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75") : secret "image-registry-tls" not found Sep 05 02:37:04.507833 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:04.507795 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:04.579359 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:04.579326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:05.192290 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:05.192254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:05.292467 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:05.292436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:05.950756 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:05.950712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:05.950931 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:05.950776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:05.950931 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:05.950898 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:37:05.950931 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:05.950917 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dcb6b888-24mhq: secret "image-registry-tls" not found Sep 05 02:37:05.950931 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:05.950917 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:37:05.951069 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:05.950970 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls podName:180b4dbf-ae7a-4848-95af-c708e48e2c59 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:09.950956905 +0000 UTC m=+42.566347883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls") pod "dns-default-lz7cq" (UID: "180b4dbf-ae7a-4848-95af-c708e48e2c59") : secret "dns-default-metrics-tls" not found Sep 05 02:37:05.951069 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:05.950989 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls podName:1818648a-354a-43a7-8bd1-11a3ad76ed75 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:09.950979544 +0000 UTC m=+42.566370519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls") pod "image-registry-9dcb6b888-24mhq" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75") : secret "image-registry-tls" not found Sep 05 02:37:06.806203 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:06.806172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:06.887458 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:06.887426 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:07.091683 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:07.091590 2577 generic.go:356] "Generic (PLEG): container finished" podID="4163c0ae-94fa-4920-bcff-8bd30ebc191d" containerID="75dc5a8e1eefcf58d3960380fde1d94c9ab1aa939ded72ef2cd6e8bf9a8253ce" exitCode=0 Sep 05 02:37:07.091838 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:07.091678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerDied","Data":"75dc5a8e1eefcf58d3960380fde1d94c9ab1aa939ded72ef2cd6e8bf9a8253ce"} Sep 05 02:37:07.093139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:07.093113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sqksf" event={"ID":"90ee08cf-b316-4875-a01b-6ec1210b9a6a","Type":"ContainerStarted","Data":"3c7db3c7ede2e855d71622d805fff55c4f96d9fbbd9d1d6c9fd5662f0d7aa9c5"} Sep 05 02:37:07.130288 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:07.130238 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sqksf" podStartSLOduration=2.010959457 podStartE2EDuration="5.130220808s" totalImagesPullingTime="3.119261351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:07.129509928 +0000 UTC m=+39.744900924" watchObservedRunningTime="2026-09-05 02:37:07.130220808 +0000 UTC m=+39.745611803" Sep 05 02:37:07.890586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:07.890557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:07.984283 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:07.984250 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:08.099096 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:08.099070 2577 generic.go:356] "Generic (PLEG): container finished" podID="4163c0ae-94fa-4920-bcff-8bd30ebc191d" containerID="e6f1c73d5c61f398ab71edb2f1a8f0b6ec8d4bd35d8540e5a0c85fada71ad24f" exitCode=0 Sep 05 02:37:08.099234 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:08.099158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerDied","Data":"e6f1c73d5c61f398ab71edb2f1a8f0b6ec8d4bd35d8540e5a0c85fada71ad24f"} Sep 05 02:37:09.105205 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:09.105169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m29bp" event={"ID":"4163c0ae-94fa-4920-bcff-8bd30ebc191d","Type":"ContainerStarted","Data":"b8ed9ad6c678c0c9003e0539da9498834a740bdddbb2a8bac27c7459e1528f55"} Sep 05 02:37:09.268531 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:09.268493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:09.357859 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:09.357775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:09.983032 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:09.982980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:09.983208 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:09.983051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:09.983208 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:09.983134 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:37:09.983208 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:09.983154 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dcb6b888-24mhq: secret "image-registry-tls" not found Sep 05 02:37:09.983208 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:09.983176 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:37:09.983370 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:09.983219 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls podName:1818648a-354a-43a7-8bd1-11a3ad76ed75 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:17.983204239 +0000 UTC m=+50.598595213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls") pod "image-registry-9dcb6b888-24mhq" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75") : secret "image-registry-tls" not found Sep 05 02:37:09.983370 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:09.983232 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls podName:180b4dbf-ae7a-4848-95af-c708e48e2c59 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:17.983226673 +0000 UTC m=+50.598617646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls") pod "dns-default-lz7cq" (UID: "180b4dbf-ae7a-4848-95af-c708e48e2c59") : secret "dns-default-metrics-tls" not found Sep 05 02:37:10.737557 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:10.737516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:10.817978 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:10.817948 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:11.336596 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.336534 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m29bp" podStartSLOduration=9.551989617 podStartE2EDuration="43.336512436s" totalImagesPullingTime="33.784522819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:09.131239184 +0000 UTC m=+41.746630182" watchObservedRunningTime="2026-09-05 02:37:11.336512436 +0000 UTC m=+43.951903427" Sep 05 02:37:11.337499 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.337481 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbk7v"] Sep 05 02:37:11.353078 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.353055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.353201 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.353125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbk7v"] Sep 05 02:37:11.355820 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.355799 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 05 02:37:11.356356 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.356337 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qnbsr\"" Sep 05 02:37:11.356501 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.356484 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 05 02:37:11.357224 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.356861 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 05 02:37:11.357402 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.357381 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 05 02:37:11.493756 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.493713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.493756 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.493763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.494004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.493786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxlk\" (UniqueName: \"kubernetes.io/projected/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-api-access-nzxlk\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.494004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.493824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/557ff409-ffe5-4239-a31c-677dbe4a88ae-data-volume\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.494004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.493872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/557ff409-ffe5-4239-a31c-677dbe4a88ae-crio-socket\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.572933 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.572891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:11.594316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.594256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.594316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.594291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.594316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.594307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxlk\" (UniqueName: \"kubernetes.io/projected/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-api-access-nzxlk\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.594559 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.594377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/557ff409-ffe5-4239-a31c-677dbe4a88ae-data-volume\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.594559 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:11.594390 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:37:11.594559 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.594461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/557ff409-ffe5-4239-a31c-677dbe4a88ae-crio-socket\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.594559 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:11.594466 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:37:11.594559 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:11.594482 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:12.094463767 +0000 UTC m=+44.709854762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : configmap "kube-rbac-proxy" not found Sep 05 02:37:11.594559 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:11.594527 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:12.094518685 +0000 UTC m=+44.709909659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : secret "insights-runtime-extractor-tls" not found Sep 05 02:37:11.594846 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.594621 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/557ff409-ffe5-4239-a31c-677dbe4a88ae-crio-socket\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.603335 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.603315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/557ff409-ffe5-4239-a31c-677dbe4a88ae-data-volume\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.606654 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.606618 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxlk\" (UniqueName: \"kubernetes.io/projected/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-api-access-nzxlk\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:11.664054 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.664022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:11.841904 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.841874 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:11.934875 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:11.934792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:12.036250 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.036213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:12.098297 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.098265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:12.098469 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.098358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:12.098469 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:12.098417 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:37:12.098580 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:12.098470 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:37:12.098580 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:12.098490 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:13.098471695 +0000 UTC m=+45.713862684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : configmap "kube-rbac-proxy" not found Sep 05 02:37:12.098580 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:12.098520 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:13.098508479 +0000 UTC m=+45.713899454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : secret "insights-runtime-extractor-tls" not found Sep 05 02:37:12.486263 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.486232 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:12.543177 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.543140 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:12.876219 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.876181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:12.970319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:12.970284 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:13.105801 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:13.105768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:13.105940 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:13.105813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:13.105940 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:13.105905 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:37:13.105940 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:13.105927 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:37:13.106081 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:13.105963 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:15.105948011 +0000 UTC m=+47.721339002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : secret "insights-runtime-extractor-tls" not found Sep 05 02:37:13.106081 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:13.105981 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:15.105968698 +0000 UTC m=+47.721359672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : configmap "kube-rbac-proxy" not found Sep 05 02:37:13.295399 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:13.295310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g8k8p_6c45887b-4b18-4283-a2e5-fb412443b413/dns-node-resolver/0.log" Sep 05 02:37:13.898246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:13.898215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:13.961544 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:13.961504 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:14.295443 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:14.295377 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dkz5p_eecf568f-0bf5-41a6-95c9-506c30629fba/node-ca/0.log" Sep 05 02:37:15.121761 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:15.121720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:15.122099 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:15.121770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:15.122099 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:15.121831 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:37:15.122099 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:15.121860 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:37:15.122099 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:15.121882 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:19.121863759 +0000 UTC m=+51.737254747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : configmap "kube-rbac-proxy" not found Sep 05 02:37:15.122099 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:15.121917 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:19.121900447 +0000 UTC m=+51.737291422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : secret "insights-runtime-extractor-tls" not found Sep 05 02:37:15.295919 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:15.295892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sqksf_90ee08cf-b316-4875-a01b-6ec1210b9a6a/serve-healthcheck-canary/0.log" Sep 05 02:37:15.531349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:15.531270 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:15.979374 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:15.979345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:18.042482 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.042445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:18.042874 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.042504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:18.042874 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:18.042585 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:37:18.042874 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:18.042599 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:37:18.042874 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:18.042622 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9dcb6b888-24mhq: secret "image-registry-tls" not found Sep 05 02:37:18.042874 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:18.042667 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls podName:180b4dbf-ae7a-4848-95af-c708e48e2c59 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:34.042630125 +0000 UTC m=+66.658021100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls") pod "dns-default-lz7cq" (UID: "180b4dbf-ae7a-4848-95af-c708e48e2c59") : secret "dns-default-metrics-tls" not found Sep 05 02:37:18.042874 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:18.042690 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls podName:1818648a-354a-43a7-8bd1-11a3ad76ed75 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:34.042680534 +0000 UTC m=+66.658071512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls") pod "image-registry-9dcb6b888-24mhq" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75") : secret "image-registry-tls" not found Sep 05 02:37:18.249469 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.249428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:18.351897 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.351866 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:18.450099 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.450069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:18.559053 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.559012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:18.752508 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.752426 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:18.852857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:18.852827 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:19.038088 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:19.038013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:19.151231 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:19.151206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:19.151568 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:19.151251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:19.151568 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:19.151350 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:37:19.151568 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:19.151412 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls podName:557ff409-ffe5-4239-a31c-677dbe4a88ae nodeName:}" failed. No retries permitted until 2026-09-05 02:37:27.151395219 +0000 UTC m=+59.766786207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbk7v" (UID: "557ff409-ffe5-4239-a31c-677dbe4a88ae") : secret "insights-runtime-extractor-tls" not found Sep 05 02:37:19.151835 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:19.151819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557ff409-ffe5-4239-a31c-677dbe4a88ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:19.381827 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:19.381800 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:20.176306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:20.176272 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:20.277174 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:20.277141 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:20.557390 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:20.557352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:20.757477 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:20.757444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:20.942161 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:20.942072 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:21.193629 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:21.193545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:21.354830 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:21.354801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:21.948425 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:21.948380 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:22.153448 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:22.153420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:22.434787 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:22.434759 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:22.547024 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:22.546994 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:22.947525 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:22.947495 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:23.006292 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:23.006260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:23.140966 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:23.140933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:23.764615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:23.764587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:24.148266 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:24.148240 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:24.679549 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:24.679521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:24.781180 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:24.781153 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:24.845544 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:24.845518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:25.457689 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:25.457626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:25.945856 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:25.945813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:26.168070 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:26.168040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:26.544308 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:26.544245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:26.711614 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:26.711585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:26.792429 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:26.792402 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:27.146233 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:27.146198 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:27.211465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:27.211426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:27.213881 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:27.213861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557ff409-ffe5-4239-a31c-677dbe4a88ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbk7v\" (UID: \"557ff409-ffe5-4239-a31c-677dbe4a88ae\") " pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:27.262561 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:27.262529 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbk7v" Sep 05 02:37:27.546749 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:27.546678 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbk7v"] Sep 05 02:37:27.550158 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:27.550130 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557ff409_ffe5_4239_a31c_677dbe4a88ae.slice/crio-662204756e1927d97508ee558dbdbdeb912c495131cd3fac7529cc2c0da984cf WatchSource:0}: Error finding container 662204756e1927d97508ee558dbdbdeb912c495131cd3fac7529cc2c0da984cf: Status 404 returned error can't find the container with id 662204756e1927d97508ee558dbdbdeb912c495131cd3fac7529cc2c0da984cf Sep 05 02:37:27.746139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:27.746115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:28.074153 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.074127 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqljf" Sep 05 02:37:28.153929 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.153897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbk7v" event={"ID":"557ff409-ffe5-4239-a31c-677dbe4a88ae","Type":"ContainerStarted","Data":"83b28844479002c090ed5743642f989a1bce8f9c8141ba72724a824d90dd56eb"} Sep 05 02:37:28.154285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.153967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbk7v" event={"ID":"557ff409-ffe5-4239-a31c-677dbe4a88ae","Type":"ContainerStarted","Data":"662204756e1927d97508ee558dbdbdeb912c495131cd3fac7529cc2c0da984cf"} Sep 05 02:37:28.363336 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.363245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:28.611960 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.611931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:28.747978 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.747947 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:28.980846 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:28.980706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:29.157546 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:29.157514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbk7v" event={"ID":"557ff409-ffe5-4239-a31c-677dbe4a88ae","Type":"ContainerStarted","Data":"87ccda9e98ad8ba3d27379ecc92e8e02a04b57ae08755f84ffff5206eab8bcc5"} Sep 05 02:37:30.161558 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:30.161517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbk7v" event={"ID":"557ff409-ffe5-4239-a31c-677dbe4a88ae","Type":"ContainerStarted","Data":"419f44dca7c9da5bf25e3b724e66840c4e4b648c3d955cf6010e189ac2159ec2"} Sep 05 02:37:30.178503 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:30.178450 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbk7v" podStartSLOduration=16.914585487 podStartE2EDuration="19.178431768s" totalImagesPullingTime="2.263846281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:37:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:30.177375757 +0000 UTC m=+62.792766754" watchObservedRunningTime="2026-09-05 02:37:30.178431768 +0000 UTC m=+62.793822758" Sep 05 02:37:32.552738 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.552677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:37:32.555037 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.555018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 05 02:37:32.566133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.566108 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9a9df36-ae83-4548-84f3-a1fa357ef62b-original-pull-secret\") pod \"global-pull-secret-syncer-hjwtk\" (UID: \"d9a9df36-ae83-4548-84f3-a1fa357ef62b\") " pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:37:32.584349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.584321 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjwtk" Sep 05 02:37:32.653187 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.653161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:37:32.655623 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.655607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 05 02:37:32.665864 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.665838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/854d055e-baf8-4237-8ae9-89a7fdb67e00-metrics-certs\") pod \"network-metrics-daemon-jb25h\" (UID: \"854d055e-baf8-4237-8ae9-89a7fdb67e00\") " pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:37:32.754065 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.754026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:32.756318 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.756301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 05 02:37:32.767006 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.766988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 05 02:37:32.777998 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.777966 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xj2c\" (UniqueName: \"kubernetes.io/projected/9b79a834-3270-4b5e-902e-d03953fc571b-kube-api-access-7xj2c\") pod \"network-check-target-2t4m9\" (UID: \"9b79a834-3270-4b5e-902e-d03953fc571b\") " pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:32.851865 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.851790 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjwtk"] Sep 05 02:37:32.856394 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:32.856370 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a9df36_ae83_4548_84f3_a1fa357ef62b.slice/crio-a87a0b1a9fff3b9a5f0999e98a78bb236be57470e447681b8a62b93acf2fc322 WatchSource:0}: Error finding container a87a0b1a9fff3b9a5f0999e98a78bb236be57470e447681b8a62b93acf2fc322: Status 404 returned error can't find the container with id a87a0b1a9fff3b9a5f0999e98a78bb236be57470e447681b8a62b93acf2fc322 Sep 05 02:37:32.878056 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.878031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2szj7\"" Sep 05 02:37:32.886775 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.886762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:32.892440 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.892422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vkq8d\"" Sep 05 02:37:32.901103 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:32.901081 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jb25h" Sep 05 02:37:33.154536 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:33.154465 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2t4m9"] Sep 05 02:37:33.158504 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:33.158478 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b79a834_3270_4b5e_902e_d03953fc571b.slice/crio-5b50941a0d8e405dca576fd1b38b8e45181168bbf111a387cf445870c85c3660 WatchSource:0}: Error finding container 5b50941a0d8e405dca576fd1b38b8e45181168bbf111a387cf445870c85c3660: Status 404 returned error can't find the container with id 5b50941a0d8e405dca576fd1b38b8e45181168bbf111a387cf445870c85c3660 Sep 05 02:37:33.169259 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:33.169234 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjwtk" event={"ID":"d9a9df36-ae83-4548-84f3-a1fa357ef62b","Type":"ContainerStarted","Data":"a87a0b1a9fff3b9a5f0999e98a78bb236be57470e447681b8a62b93acf2fc322"} Sep 05 02:37:33.170408 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:33.170386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2t4m9" event={"ID":"9b79a834-3270-4b5e-902e-d03953fc571b","Type":"ContainerStarted","Data":"5b50941a0d8e405dca576fd1b38b8e45181168bbf111a387cf445870c85c3660"} Sep 05 02:37:33.174634 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:33.174613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jb25h"] Sep 05 02:37:33.177680 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:33.177655 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854d055e_baf8_4237_8ae9_89a7fdb67e00.slice/crio-59461de803756de770b40c19e099d5a6b43588c3bb1f759cf109b611518e2687 WatchSource:0}: Error finding container 59461de803756de770b40c19e099d5a6b43588c3bb1f759cf109b611518e2687: Status 404 returned error can't find the container with id 59461de803756de770b40c19e099d5a6b43588c3bb1f759cf109b611518e2687 Sep 05 02:37:34.063841 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.063800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:34.064317 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.063866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:34.067193 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.067165 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"image-registry-9dcb6b888-24mhq\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:34.067399 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.067347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/180b4dbf-ae7a-4848-95af-c708e48e2c59-metrics-tls\") pod \"dns-default-lz7cq\" (UID: \"180b4dbf-ae7a-4848-95af-c708e48e2c59\") " pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:34.175556 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.175518 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jb25h" event={"ID":"854d055e-baf8-4237-8ae9-89a7fdb67e00","Type":"ContainerStarted","Data":"59461de803756de770b40c19e099d5a6b43588c3bb1f759cf109b611518e2687"} Sep 05 02:37:34.324623 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.324558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5mmzg\"" Sep 05 02:37:34.333479 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.333264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:34.354605 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.354576 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd"] Sep 05 02:37:34.354863 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.354842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-njhk9\"" Sep 05 02:37:34.361254 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.361229 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w"] Sep 05 02:37:34.361775 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.361755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.362853 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.362821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:34.364993 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.364959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 05 02:37:34.365733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.365346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 05 02:37:34.365733 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.365424 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 05 02:37:34.365891 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.365756 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-489nn"] Sep 05 02:37:34.365891 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.365842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.368565 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.366374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 05 02:37:34.368565 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.367901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mkxhj\"" Sep 05 02:37:34.373883 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.372510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 05 02:37:34.375764 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.375150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.375764 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.375316 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w"] Sep 05 02:37:34.375764 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.375353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd"] Sep 05 02:37:34.379254 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.379206 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zmlqs\"" Sep 05 02:37:34.379394 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.379357 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 05 02:37:34.379832 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.379556 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 05 02:37:34.387068 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.387031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-489nn"] Sep 05 02:37:34.388361 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.388290 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9dcb6b888-24mhq"] Sep 05 02:37:34.466349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.466270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d915a12c-eb84-491c-9cb8-66f0b1a4e032-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.466349 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.466346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4t94\" (UniqueName: \"kubernetes.io/projected/d915a12c-eb84-491c-9cb8-66f0b1a4e032-kube-api-access-l4t94\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.466601 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.466423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d915a12c-eb84-491c-9cb8-66f0b1a4e032-tmp\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.551336 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.551291 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:34.567635 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4t94\" (UniqueName: \"kubernetes.io/projected/d915a12c-eb84-491c-9cb8-66f0b1a4e032-kube-api-access-l4t94\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.567828 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d915a12c-eb84-491c-9cb8-66f0b1a4e032-tmp\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.567828 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d915a12c-eb84-491c-9cb8-66f0b1a4e032-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.567828 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w\" (UID: \"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.567828 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmj7g\" (UniqueName: \"kubernetes.io/projected/ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd-kube-api-access-jmj7g\") pod \"managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w\" (UID: \"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.567828 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a01e8a2-87d5-45d4-b149-c5fbb9316231-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-489nn\" (UID: \"0a01e8a2-87d5-45d4-b149-c5fbb9316231\") " pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.568143 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.567856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a01e8a2-87d5-45d4-b149-c5fbb9316231-nginx-conf\") pod \"networking-console-plugin-79977f9844-489nn\" (UID: \"0a01e8a2-87d5-45d4-b149-c5fbb9316231\") " pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.568219 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.568202 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d915a12c-eb84-491c-9cb8-66f0b1a4e032-tmp\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.571031 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.571009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d915a12c-eb84-491c-9cb8-66f0b1a4e032-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.584930 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.584871 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4t94\" (UniqueName: \"kubernetes.io/projected/d915a12c-eb84-491c-9cb8-66f0b1a4e032-kube-api-access-l4t94\") pod \"klusterlet-addon-workmgr-7f869dd9b9-fhsgd\" (UID: \"d915a12c-eb84-491c-9cb8-66f0b1a4e032\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.644169 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.644138 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9dcb6b888-24mhq"] Sep 05 02:37:34.653932 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.653905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:34.668433 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.668407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w\" (UID: \"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.668567 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.668456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmj7g\" (UniqueName: \"kubernetes.io/projected/ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd-kube-api-access-jmj7g\") pod \"managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w\" (UID: \"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.668567 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.668500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a01e8a2-87d5-45d4-b149-c5fbb9316231-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-489nn\" (UID: \"0a01e8a2-87d5-45d4-b149-c5fbb9316231\") " pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.668567 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.668533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a01e8a2-87d5-45d4-b149-c5fbb9316231-nginx-conf\") pod \"networking-console-plugin-79977f9844-489nn\" (UID: \"0a01e8a2-87d5-45d4-b149-c5fbb9316231\") " pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.669137 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.669116 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a01e8a2-87d5-45d4-b149-c5fbb9316231-nginx-conf\") pod \"networking-console-plugin-79977f9844-489nn\" (UID: \"0a01e8a2-87d5-45d4-b149-c5fbb9316231\") " pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.671594 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.671547 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a01e8a2-87d5-45d4-b149-c5fbb9316231-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-489nn\" (UID: \"0a01e8a2-87d5-45d4-b149-c5fbb9316231\") " pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.673630 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.673590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w\" (UID: \"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.684671 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.684476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lz7cq"] Sep 05 02:37:34.687369 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.687203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:34.687369 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.687251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmj7g\" (UniqueName: \"kubernetes.io/projected/ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd-kube-api-access-jmj7g\") pod \"managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w\" (UID: \"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.687369 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:34.687298 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180b4dbf_ae7a_4848_95af_c708e48e2c59.slice/crio-e10e35dbd266cb997714708292e26460d357cc5824bf860ce57d5737c8712c42 WatchSource:0}: Error finding container e10e35dbd266cb997714708292e26460d357cc5824bf860ce57d5737c8712c42: Status 404 returned error can't find the container with id e10e35dbd266cb997714708292e26460d357cc5824bf860ce57d5737c8712c42 Sep 05 02:37:34.702742 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.702722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" Sep 05 02:37:34.714813 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.714778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" Sep 05 02:37:34.757454 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.757419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:34.870757 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.870729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:34.964986 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:34.964905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:35.020142 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.020103 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd"] Sep 05 02:37:35.024067 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:35.024031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd915a12c_eb84_491c_9cb8_66f0b1a4e032.slice/crio-9513d151166720ebe709526f132d910b8aea2fff0e26637abb746dd3e947f103 WatchSource:0}: Error finding container 9513d151166720ebe709526f132d910b8aea2fff0e26637abb746dd3e947f103: Status 404 returned error can't find the container with id 9513d151166720ebe709526f132d910b8aea2fff0e26637abb746dd3e947f103 Sep 05 02:37:35.052963 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.052898 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w"] Sep 05 02:37:35.057230 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:35.057201 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac98fc34_83ca_4ee0_be59_b8ed1af0f8fd.slice/crio-808a788870aee2fe4d8789af6b67ba4a5e3f74aafc9ba1bd9a5b4058f97cb2bf WatchSource:0}: Error finding container 808a788870aee2fe4d8789af6b67ba4a5e3f74aafc9ba1bd9a5b4058f97cb2bf: Status 404 returned error can't find the container with id 808a788870aee2fe4d8789af6b67ba4a5e3f74aafc9ba1bd9a5b4058f97cb2bf Sep 05 02:37:35.086094 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.086007 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-489nn"] Sep 05 02:37:35.091308 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:35.091267 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a01e8a2_87d5_45d4_b149_c5fbb9316231.slice/crio-3ff5f9dec95646a3d49dee7f7ee4eeffc5b1f63c6fe99a8026f69253d8c530f0 WatchSource:0}: Error finding container 3ff5f9dec95646a3d49dee7f7ee4eeffc5b1f63c6fe99a8026f69253d8c530f0: Status 404 returned error can't find the container with id 3ff5f9dec95646a3d49dee7f7ee4eeffc5b1f63c6fe99a8026f69253d8c530f0 Sep 05 02:37:35.190681 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.189828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jb25h" event={"ID":"854d055e-baf8-4237-8ae9-89a7fdb67e00","Type":"ContainerStarted","Data":"fb1df25f655be3ac2cf4178b91ef44697d8fbd5d32f4f1772f5cdf4d37769148"} Sep 05 02:37:35.190681 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.189930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jb25h" event={"ID":"854d055e-baf8-4237-8ae9-89a7fdb67e00","Type":"ContainerStarted","Data":"b10125ed728a79e904d020b7afc9cc670515a5d6daf52dece6913884b0c41cb4"} Sep 05 02:37:35.192173 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.192131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" event={"ID":"0a01e8a2-87d5-45d4-b149-c5fbb9316231","Type":"ContainerStarted","Data":"3ff5f9dec95646a3d49dee7f7ee4eeffc5b1f63c6fe99a8026f69253d8c530f0"} Sep 05 02:37:35.193600 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.193569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" event={"ID":"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd","Type":"ContainerStarted","Data":"808a788870aee2fe4d8789af6b67ba4a5e3f74aafc9ba1bd9a5b4058f97cb2bf"} Sep 05 02:37:35.195262 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.195142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" event={"ID":"d915a12c-eb84-491c-9cb8-66f0b1a4e032","Type":"ContainerStarted","Data":"9513d151166720ebe709526f132d910b8aea2fff0e26637abb746dd3e947f103"} Sep 05 02:37:35.197261 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.197204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lz7cq" event={"ID":"180b4dbf-ae7a-4848-95af-c708e48e2c59","Type":"ContainerStarted","Data":"e10e35dbd266cb997714708292e26460d357cc5824bf860ce57d5737c8712c42"} Sep 05 02:37:35.199832 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.199808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" event={"ID":"1818648a-354a-43a7-8bd1-11a3ad76ed75","Type":"ContainerStarted","Data":"f2f560b9f927e31fbb4d36d3f5d49a61f1af7efd0161ae7f18c1354dba8eceaf"} Sep 05 02:37:35.199990 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.199844 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" event={"ID":"1818648a-354a-43a7-8bd1-11a3ad76ed75","Type":"ContainerStarted","Data":"33755113bcf92ef27faa1d6ee1bd75ac9ddb53be7b66a5d751337622ba3fd50d"} Sep 05 02:37:35.199990 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.199953 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:37:35.255566 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.254953 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" podStartSLOduration=34.254929228 podStartE2EDuration="34.254929228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:35.254092451 +0000 UTC m=+67.869483447" watchObservedRunningTime="2026-09-05 02:37:35.254929228 +0000 UTC m=+67.870320225" Sep 05 02:37:35.255566 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.255295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jb25h" podStartSLOduration=66.246105027 podStartE2EDuration="1m7.255287253s" totalImagesPullingTime="1.009182226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:35.219802226 +0000 UTC m=+67.835193226" watchObservedRunningTime="2026-09-05 02:37:35.255287253 +0000 UTC m=+67.870678250" Sep 05 02:37:35.262367 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.262333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:35.360698 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.360665 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:35.896540 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:35.896506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:36.227075 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:36.226990 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:36.330512 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:36.330472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:38.606707 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:38.606614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:38.686971 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:38.686938 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:38.794033 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:38.794002 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:38.924392 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:38.924308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:41.825052 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.825016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:41.863062 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.863026 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fg2hz"] Sep 05 02:37:41.865882 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.865862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:41.870060 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.870036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 05 02:37:41.870845 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.870817 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 05 02:37:41.870845 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.870836 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 05 02:37:41.871026 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.870836 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-87jfc\"" Sep 05 02:37:41.871026 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.870839 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 05 02:37:41.871126 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.871081 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 05 02:37:41.876607 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.876574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fg2hz"] Sep 05 02:37:41.900357 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.900329 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:41.921536 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.921511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkk7f\" (UniqueName: \"kubernetes.io/projected/7b30bf5e-6a07-48c5-86f0-477b43a2086e-kube-api-access-xkk7f\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:41.921663 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.921541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:41.921663 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.921559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:41.921663 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:41.921582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b30bf5e-6a07-48c5-86f0-477b43a2086e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.022890 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.022858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkk7f\" (UniqueName: \"kubernetes.io/projected/7b30bf5e-6a07-48c5-86f0-477b43a2086e-kube-api-access-xkk7f\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.022890 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.022907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.023137 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:42.023013 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 05 02:37:42.023137 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.023029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.023137 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:42.023071 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-tls podName:7b30bf5e-6a07-48c5-86f0-477b43a2086e nodeName:}" failed. No retries permitted until 2026-09-05 02:37:42.523053002 +0000 UTC m=+75.138443991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-fg2hz" (UID: "7b30bf5e-6a07-48c5-86f0-477b43a2086e") : secret "prometheus-operator-tls" not found Sep 05 02:37:42.023137 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.023109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b30bf5e-6a07-48c5-86f0-477b43a2086e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.023902 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.023879 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b30bf5e-6a07-48c5-86f0-477b43a2086e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.025619 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.025598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.032126 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.032104 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkk7f\" (UniqueName: \"kubernetes.io/projected/7b30bf5e-6a07-48c5-86f0-477b43a2086e-kube-api-access-xkk7f\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.183849 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.183764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:42.527696 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.527302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.530765 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.530705 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b30bf5e-6a07-48c5-86f0-477b43a2086e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fg2hz\" (UID: \"7b30bf5e-6a07-48c5-86f0-477b43a2086e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.777778 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.777682 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" Sep 05 02:37:42.939340 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:42.939285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:43.009598 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.009549 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:43.047111 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.047060 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fg2hz"] Sep 05 02:37:43.051708 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:43.051685 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b30bf5e_6a07_48c5_86f0_477b43a2086e.slice/crio-13703224f7d4d7cf02de8811e266a66e313678637e458b054b90c4244caa6ad9 WatchSource:0}: Error finding container 13703224f7d4d7cf02de8811e266a66e313678637e458b054b90c4244caa6ad9: Status 404 returned error can't find the container with id 13703224f7d4d7cf02de8811e266a66e313678637e458b054b90c4244caa6ad9 Sep 05 02:37:43.074180 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.074140 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:43.233067 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.233030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lz7cq" event={"ID":"180b4dbf-ae7a-4848-95af-c708e48e2c59","Type":"ContainerStarted","Data":"ad974f4e40a774e851c36259928c6fab695cb594c9f949b8e759ea60a8873870"} Sep 05 02:37:43.233199 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.233103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lz7cq" event={"ID":"180b4dbf-ae7a-4848-95af-c708e48e2c59","Type":"ContainerStarted","Data":"7c7b5827157c240e926f5d5e4ad73e2e71de0c39670b978ebbc70e058877ad71"} Sep 05 02:37:43.233199 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.233172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:43.234384 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.234363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" event={"ID":"7b30bf5e-6a07-48c5-86f0-477b43a2086e","Type":"ContainerStarted","Data":"13703224f7d4d7cf02de8811e266a66e313678637e458b054b90c4244caa6ad9"} Sep 05 02:37:43.235867 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.235848 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2t4m9" event={"ID":"9b79a834-3270-4b5e-902e-d03953fc571b","Type":"ContainerStarted","Data":"cab56f5f3a9069f9ef6eef7ad71a1fd0f64c285477aac8d68ec10a5440c00c24"} Sep 05 02:37:43.235967 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.235951 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:37:43.237510 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.237481 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjwtk" event={"ID":"d9a9df36-ae83-4548-84f3-a1fa357ef62b","Type":"ContainerStarted","Data":"7466cfd6caa2085a2aebfbae653f109f5d104cdee011d7e2944e7c9508c5cb67"} Sep 05 02:37:43.238819 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.238801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" event={"ID":"0a01e8a2-87d5-45d4-b149-c5fbb9316231","Type":"ContainerStarted","Data":"a9a3dbd469e5bbac20e2e2b43899ffb3d26e7bdc34e21e1735d4936f6bc67ad0"} Sep 05 02:37:43.240223 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.240203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" event={"ID":"ac98fc34-83ca-4ee0-be59-b8ed1af0f8fd","Type":"ContainerStarted","Data":"8e6cf8355a03dcff25af91dbc22ff3c0d40178958748bdb8b7288a9efcd12585"} Sep 05 02:37:43.241476 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.241458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" event={"ID":"d915a12c-eb84-491c-9cb8-66f0b1a4e032","Type":"ContainerStarted","Data":"ecb8eacb67b3a2447616ce8dc5eafb9f856e320a7c68d028f1c06c725525e249"} Sep 05 02:37:43.241659 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.241635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:43.243278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.243261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" Sep 05 02:37:43.254166 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.254126 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lz7cq" podStartSLOduration=33.593346253 podStartE2EDuration="41.254114469s" totalImagesPullingTime="7.660768216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:43.252375024 +0000 UTC m=+75.867766020" watchObservedRunningTime="2026-09-05 02:37:43.254114469 +0000 UTC m=+75.869505465" Sep 05 02:37:43.275327 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.275288 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hjwtk" podStartSLOduration=65.785917121 podStartE2EDuration="1m15.275276646s" totalImagesPullingTime="9.489359525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:43.274754286 +0000 UTC m=+75.890145283" watchObservedRunningTime="2026-09-05 02:37:43.275276646 +0000 UTC m=+75.890667641" Sep 05 02:37:43.294521 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.294481 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2t4m9" podStartSLOduration=68.272639093 podStartE2EDuration="1m15.294465958s" totalImagesPullingTime="7.021826865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:43.294039956 +0000 UTC m=+75.909430952" watchObservedRunningTime="2026-09-05 02:37:43.294465958 +0000 UTC m=+75.909856955" Sep 05 02:37:43.309882 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.309844 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f869dd9b9-fhsgd" podStartSLOduration=1.929502646 podStartE2EDuration="9.30983213s" totalImagesPullingTime="7.380329484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:43.30923718 +0000 UTC m=+75.924628186" watchObservedRunningTime="2026-09-05 02:37:43.30983213 +0000 UTC m=+75.925223129" Sep 05 02:37:43.323707 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.323675 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8ddfb7f74-6bw4w" podStartSLOduration=2.004624455 podStartE2EDuration="9.323659893s" totalImagesPullingTime="7.319035438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:43.323363112 +0000 UTC m=+75.938754109" watchObservedRunningTime="2026-09-05 02:37:43.323659893 +0000 UTC m=+75.939050884" Sep 05 02:37:43.340549 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.340510 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-489nn" podStartSLOduration=2.086040594 podStartE2EDuration="9.340499449s" totalImagesPullingTime="7.254458855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:43.340243072 +0000 UTC m=+75.955634069" watchObservedRunningTime="2026-09-05 02:37:43.340499449 +0000 UTC m=+75.955890445" Sep 05 02:37:43.460411 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.460376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:43.518124 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.518094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:43.576550 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:43.576491 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:45.251363 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:45.251334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" event={"ID":"7b30bf5e-6a07-48c5-86f0-477b43a2086e","Type":"ContainerStarted","Data":"7a033f60b4b10826422c0f896bc36b1dc6f9d431018e43d046fbb0a670a9f7c8"} Sep 05 02:37:45.251861 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:45.251392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" event={"ID":"7b30bf5e-6a07-48c5-86f0-477b43a2086e","Type":"ContainerStarted","Data":"a3928868c46610f8f76fe808d38e4ce09f925e94d17eac346956dee84a6257d8"} Sep 05 02:37:45.269737 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:45.269687 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-fg2hz" podStartSLOduration=2.214100749 podStartE2EDuration="4.269670059s" totalImagesPullingTime="2.05556931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:45.268365226 +0000 UTC m=+77.883756233" watchObservedRunningTime="2026-09-05 02:37:45.269670059 +0000 UTC m=+77.885061055" Sep 05 02:37:45.401452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:45.401382 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:46.981328 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:46.981295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.218941 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.218907 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.287063 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.286983 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p"] Sep 05 02:37:47.289151 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.289134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.291524 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.291496 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zkqz7"] Sep 05 02:37:47.292310 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.292289 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 05 02:37:47.292701 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.292682 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gtpr5\"" Sep 05 02:37:47.293181 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.293156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 05 02:37:47.293267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.293201 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 05 02:37:47.293548 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.293531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.297812 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.297793 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 05 02:37:47.297921 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.297896 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 05 02:37:47.298768 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.298752 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nggjs\"" Sep 05 02:37:47.298768 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.298772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 05 02:37:47.311220 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.311199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p"] Sep 05 02:37:47.318282 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.318252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.362689 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.362857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.362857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-sys\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.362857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d454a88-0042-44f3-a24b-512ee8748739-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.362857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.362857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d454a88-0042-44f3-a24b-512ee8748739-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-tls\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqmd\" (UniqueName: \"kubernetes.io/projected/57aa1c20-6894-420c-b023-4aabe1680c9e-kube-api-access-ttqmd\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-root\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.362980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-textfile\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.363038 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.363019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57aa1c20-6894-420c-b023-4aabe1680c9e-metrics-client-ca\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.363279 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.363048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-wtmp\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.363279 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.363065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zzwb\" (UniqueName: \"kubernetes.io/projected/0d454a88-0042-44f3-a24b-512ee8748739-kube-api-access-7zzwb\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.414605 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.414571 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.464039 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-wtmp\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zzwb\" (UniqueName: \"kubernetes.io/projected/0d454a88-0042-44f3-a24b-512ee8748739-kube-api-access-7zzwb\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.464214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.464214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-sys\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d454a88-0042-44f3-a24b-512ee8748739-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.464214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-wtmp\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464237 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-sys\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d454a88-0042-44f3-a24b-512ee8748739-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-tls\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqmd\" (UniqueName: \"kubernetes.io/projected/57aa1c20-6894-420c-b023-4aabe1680c9e-kube-api-access-ttqmd\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.464475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-root\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464922 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:47.464501 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 05 02:37:47.464922 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:37:47.464598 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-tls podName:0d454a88-0042-44f3-a24b-512ee8748739 nodeName:}" failed. No retries permitted until 2026-09-05 02:37:47.96457688 +0000 UTC m=+80.579967857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-zwr9p" (UID: "0d454a88-0042-44f3-a24b-512ee8748739") : secret "kube-state-metrics-tls" not found Sep 05 02:37:47.464922 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57aa1c20-6894-420c-b023-4aabe1680c9e-root\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464922 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-textfile\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464922 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57aa1c20-6894-420c-b023-4aabe1680c9e-metrics-client-ca\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.464922 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.464861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d454a88-0042-44f3-a24b-512ee8748739-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.465225 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.465045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.465225 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.465164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.465327 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.465271 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57aa1c20-6894-420c-b023-4aabe1680c9e-metrics-client-ca\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.465392 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.465371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-textfile\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.465469 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.465448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d454a88-0042-44f3-a24b-512ee8748739-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.466977 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.466948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.467112 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.467093 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.467286 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.467270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57aa1c20-6894-420c-b023-4aabe1680c9e-node-exporter-tls\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.475346 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.475324 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqmd\" (UniqueName: \"kubernetes.io/projected/57aa1c20-6894-420c-b023-4aabe1680c9e-kube-api-access-ttqmd\") pod \"node-exporter-zkqz7\" (UID: \"57aa1c20-6894-420c-b023-4aabe1680c9e\") " pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.478208 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.478184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zzwb\" (UniqueName: \"kubernetes.io/projected/0d454a88-0042-44f3-a24b-512ee8748739-kube-api-access-7zzwb\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.515799 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.515768 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.604216 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.604180 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkqz7" Sep 05 02:37:47.614801 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:47.614781 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57aa1c20_6894_420c_b023_4aabe1680c9e.slice/crio-21c7d90d4478ffe684f9cb0227e57278933c119ade8efcd0234f2965dd13cc0d WatchSource:0}: Error finding container 21c7d90d4478ffe684f9cb0227e57278933c119ade8efcd0234f2965dd13cc0d: Status 404 returned error can't find the container with id 21c7d90d4478ffe684f9cb0227e57278933c119ade8efcd0234f2965dd13cc0d Sep 05 02:37:47.630719 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.630698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.721665 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.721613 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.941942 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.941859 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:47.968042 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.968009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:47.970408 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:47.970390 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d454a88-0042-44f3-a24b-512ee8748739-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-zwr9p\" (UID: \"0d454a88-0042-44f3-a24b-512ee8748739\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:48.199358 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.199274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" Sep 05 02:37:48.259278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.259247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:48.265217 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.265181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkqz7" event={"ID":"57aa1c20-6894-420c-b023-4aabe1680c9e","Type":"ContainerStarted","Data":"21c7d90d4478ffe684f9cb0227e57278933c119ade8efcd0234f2965dd13cc0d"} Sep 05 02:37:48.361201 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.361137 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:48.379205 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.379173 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:37:48.382598 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.382579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.384811 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.384791 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 05 02:37:48.385303 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385229 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 05 02:37:48.385303 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 05 02:37:48.385303 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385298 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 05 02:37:48.385508 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385395 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 05 02:37:48.385508 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385486 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 05 02:37:48.385609 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385583 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 05 02:37:48.385700 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385691 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g6t2f\"" Sep 05 02:37:48.385765 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 05 02:37:48.385765 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.385739 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 05 02:37:48.400794 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.400770 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:37:48.472453 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-out\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472453 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472453 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcn24\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-kube-api-access-mcn24\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.472850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.472835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-web-config\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.480424 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.480313 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p"] Sep 05 02:37:48.481011 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.480883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:48.483634 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:48.483608 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d454a88_0042_44f3_a24b_512ee8748739.slice/crio-7deff1a34660b908abcce7c86b17fd0031f56f5d5520b3a9c3d8b4810b6111ae WatchSource:0}: Error finding container 7deff1a34660b908abcce7c86b17fd0031f56f5d5520b3a9c3d8b4810b6111ae: Status 404 returned error can't find the container with id 7deff1a34660b908abcce7c86b17fd0031f56f5d5520b3a9c3d8b4810b6111ae Sep 05 02:37:48.573740 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.573702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.573938 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.573762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.573938 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.573794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.573938 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.573823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574103 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.573951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-web-config\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574103 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-out\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574103 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcn24\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-kube-api-access-mcn24\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.574316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.575268 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.574699 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.576040 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.576013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.576298 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.576274 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.577572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.577547 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.578402 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.578374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-web-config\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.579136 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.579092 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-out\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.579136 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.579103 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.579519 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.579492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.580057 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.579918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.580057 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.580020 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.580057 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.580028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-volume\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.581105 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.581079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.583475 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.583444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcn24\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-kube-api-access-mcn24\") pod \"alertmanager-main-0\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.701358 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.701323 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:37:48.986076 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:48.985998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:37:48.989805 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:48.989769 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6322b0d3_7f36_4927_b34f_e96f7025b89a.slice/crio-367cbe3eec643404237f7e3a75d3cf45b1c7e5ae9ff1255d10a04a0e735c2aae WatchSource:0}: Error finding container 367cbe3eec643404237f7e3a75d3cf45b1c7e5ae9ff1255d10a04a0e735c2aae: Status 404 returned error can't find the container with id 367cbe3eec643404237f7e3a75d3cf45b1c7e5ae9ff1255d10a04a0e735c2aae Sep 05 02:37:49.270906 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:49.270809 2577 generic.go:356] "Generic (PLEG): container finished" podID="57aa1c20-6894-420c-b023-4aabe1680c9e" containerID="8df6508a3a62b99cc3afce8f8d9bf8ee9a3218055e704d4a712b03c7f5781987" exitCode=0 Sep 05 02:37:49.271365 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:49.270935 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkqz7" event={"ID":"57aa1c20-6894-420c-b023-4aabe1680c9e","Type":"ContainerDied","Data":"8df6508a3a62b99cc3afce8f8d9bf8ee9a3218055e704d4a712b03c7f5781987"} Sep 05 02:37:49.272466 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:49.272438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"367cbe3eec643404237f7e3a75d3cf45b1c7e5ae9ff1255d10a04a0e735c2aae"} Sep 05 02:37:49.273843 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:49.273800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" event={"ID":"0d454a88-0042-44f3-a24b-512ee8748739","Type":"ContainerStarted","Data":"7deff1a34660b908abcce7c86b17fd0031f56f5d5520b3a9c3d8b4810b6111ae"} Sep 05 02:37:50.268499 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.268472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:50.278377 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.278349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" event={"ID":"0d454a88-0042-44f3-a24b-512ee8748739","Type":"ContainerStarted","Data":"c92029dbce3cbc089bdc242a5fa22a1ce02101c56d444878800ccecff665c842"} Sep 05 02:37:50.280711 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.280684 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkqz7" event={"ID":"57aa1c20-6894-420c-b023-4aabe1680c9e","Type":"ContainerStarted","Data":"eb1e788d85abfc4ae8c0289d4abe3beb3c80ba95cd7e3316e27c1444a11ca608"} Sep 05 02:37:50.280843 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.280739 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkqz7" event={"ID":"57aa1c20-6894-420c-b023-4aabe1680c9e","Type":"ContainerStarted","Data":"cfc1eaceacf41ff98c25149f6b88e95823f341f3ba85f220d1133f3db645c989"} Sep 05 02:37:50.282783 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.282744 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0" exitCode=0 Sep 05 02:37:50.282894 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.282800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0"} Sep 05 02:37:50.311023 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.310156 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zkqz7" podStartSLOduration=2.124733159 podStartE2EDuration="3.310138168s" totalImagesPullingTime="1.116819288s" totalInitContainerRuntime="68.585721ms" isStatefulPod=true podCreationTimestamp="2026-09-05 02:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:50.309573217 +0000 UTC m=+82.924964214" watchObservedRunningTime="2026-09-05 02:37:50.310138168 +0000 UTC m=+82.925529164" Sep 05 02:37:50.430572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.430469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:50.434134 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.434096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt"] Sep 05 02:37:50.439361 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.439335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.444382 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.444325 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 05 02:37:50.444382 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.444344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 05 02:37:50.444763 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.444747 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ek911etdiim4m\"" Sep 05 02:37:50.444918 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.444905 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 05 02:37:50.444978 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.444940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 05 02:37:50.445028 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.444998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-smptk\"" Sep 05 02:37:50.445091 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.445073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 05 02:37:50.458563 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.458540 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt"] Sep 05 02:37:50.491263 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491400 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnltv\" (UniqueName: \"kubernetes.io/projected/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-kube-api-access-tnltv\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491400 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491550 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-tls\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491550 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-metrics-client-ca\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491550 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491550 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.491716 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.491553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-grpc-tls\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592147 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnltv\" (UniqueName: \"kubernetes.io/projected/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-kube-api-access-tnltv\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-tls\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-metrics-client-ca\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-grpc-tls\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.592865 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.592819 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:50.593670 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.593616 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-metrics-client-ca\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.595368 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.595334 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.595511 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.595483 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.595758 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.595728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.595850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.595768 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-tls\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.596139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.596121 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.596228 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.596208 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-secret-grpc-tls\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.601421 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.601397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnltv\" (UniqueName: \"kubernetes.io/projected/b9b7daa3-a16d-4f77-8d91-e3e4541c0860-kube-api-access-tnltv\") pod \"thanos-querier-f7cf9c7bf-ghctt\" (UID: \"b9b7daa3-a16d-4f77-8d91-e3e4541c0860\") " pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:50.749474 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:50.749376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:51.035500 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:51.035419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt"] Sep 05 02:37:51.038937 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:37:51.038912 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b7daa3_a16d_4f77_8d91_e3e4541c0860.slice/crio-2f4323fa164e6b7479ef9c7eeefaa1f2818819356d650c0f5f0de795a0792e71 WatchSource:0}: Error finding container 2f4323fa164e6b7479ef9c7eeefaa1f2818819356d650c0f5f0de795a0792e71: Status 404 returned error can't find the container with id 2f4323fa164e6b7479ef9c7eeefaa1f2818819356d650c0f5f0de795a0792e71 Sep 05 02:37:51.289016 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:51.288932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" event={"ID":"0d454a88-0042-44f3-a24b-512ee8748739","Type":"ContainerStarted","Data":"770334ffbcd6beb2b0206e0a9253e69021bfafa5958f49d28d7a3c35d9602a0b"} Sep 05 02:37:51.289016 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:51.288997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" event={"ID":"0d454a88-0042-44f3-a24b-512ee8748739","Type":"ContainerStarted","Data":"a7b6700f719b050da73cb1fef9a7122f66466ca8c16617616376ada29e4f39f8"} Sep 05 02:37:51.290789 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:51.290756 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"2f4323fa164e6b7479ef9c7eeefaa1f2818819356d650c0f5f0de795a0792e71"} Sep 05 02:37:51.308483 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:51.308427 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-zwr9p" podStartSLOduration=2.668356513 podStartE2EDuration="4.308406072s" totalImagesPullingTime="1.640049559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:51.307565151 +0000 UTC m=+83.922956147" watchObservedRunningTime="2026-09-05 02:37:51.308406072 +0000 UTC m=+83.923797070" Sep 05 02:37:52.006514 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.006454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:52.302457 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.302407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90"} Sep 05 02:37:52.302934 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.302502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2"} Sep 05 02:37:52.302934 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.302548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba"} Sep 05 02:37:52.302934 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.302591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255"} Sep 05 02:37:52.302934 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.302636 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a"} Sep 05 02:37:52.448482 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:52.448409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:53.246590 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:53.246551 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lz7cq" Sep 05 02:37:53.315673 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:53.315618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"14323a231f648fc31d6d4be83fffbfbd50acd35fcc396f6327f8acdb700e44a9"} Sep 05 02:37:53.316224 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:53.315730 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"2e4e3c1d7d2f1253ff497022ff148e9d82141136ce38227ea4a59ef13ecc8db3"} Sep 05 02:37:53.316224 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:53.315775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"f80b9fa9cef6e3657ea9234bc8088971893c9072a8a474511674b57dc66bf9ea"} Sep 05 02:37:53.637388 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:53.637301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:54.119588 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.119556 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:54.219517 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.219418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:54.323178 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.323143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerStarted","Data":"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd"} Sep 05 02:37:54.326363 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.326334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"cdfe4632769a0438d96cca911dcf86d0e0fb02df774f3ea37697b19645091ec6"} Sep 05 02:37:54.326510 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.326403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"8c94b686c3eef702f99ef00240f6154b3130524fda244daed6938294624ac93b"} Sep 05 02:37:54.326510 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.326454 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:37:54.326510 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.326494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" event={"ID":"b9b7daa3-a16d-4f77-8d91-e3e4541c0860","Type":"ContainerStarted","Data":"9189cc6b7ada1fe5d7ebeefd3c7450d0a3a95e257efb3010193ae2b4d7de8c7d"} Sep 05 02:37:54.356334 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.356287 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.318961904 podStartE2EDuration="6.356260812s" totalImagesPullingTime="4.018121017s" totalInitContainerRuntime="19.177891ms" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:54.354153683 +0000 UTC m=+86.969544691" watchObservedRunningTime="2026-09-05 02:37:54.356260812 +0000 UTC m=+86.971651809" Sep 05 02:37:54.387128 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.386962 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" podStartSLOduration=1.682919653 podStartE2EDuration="4.386923788s" totalImagesPullingTime="2.704004135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:37:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:37:54.38681774 +0000 UTC m=+87.002208737" watchObservedRunningTime="2026-09-05 02:37:54.386923788 +0000 UTC m=+87.002314785" Sep 05 02:37:54.824809 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.824773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:54.926218 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:54.926178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:55.206032 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:55.205927 2577 patch_prober.go:28] interesting pod/image-registry-9dcb6b888-24mhq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 05 02:37:55.206032 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:55.205997 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" podUID="1818648a-354a-43a7-8bd1-11a3ad76ed75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:37:56.939326 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:56.939292 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:37:57.034788 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:37:57.034756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:00.225232 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.225174 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" podUID="1818648a-354a-43a7-8bd1-11a3ad76ed75" containerName="registry" containerID="cri-o://f2f560b9f927e31fbb4d36d3f5d49a61f1af7efd0161ae7f18c1354dba8eceaf" gracePeriod=30 Sep 05 02:38:00.336752 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.336724 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f7cf9c7bf-ghctt" Sep 05 02:38:00.352091 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.352064 2577 generic.go:356] "Generic (PLEG): container finished" podID="1818648a-354a-43a7-8bd1-11a3ad76ed75" containerID="f2f560b9f927e31fbb4d36d3f5d49a61f1af7efd0161ae7f18c1354dba8eceaf" exitCode=0 Sep 05 02:38:00.352210 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.352095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" event={"ID":"1818648a-354a-43a7-8bd1-11a3ad76ed75","Type":"ContainerDied","Data":"f2f560b9f927e31fbb4d36d3f5d49a61f1af7efd0161ae7f18c1354dba8eceaf"} Sep 05 02:38:00.478015 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.477956 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:38:00.578287 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578252 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-certificates\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578308 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5jws\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-kube-api-access-c5jws\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578362 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-image-registry-private-configuration\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578398 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-bound-sa-token\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578424 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1818648a-354a-43a7-8bd1-11a3ad76ed75-ca-trust-extracted\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578726 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578473 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578726 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578501 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-trusted-ca\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578726 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578547 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-installation-pull-secrets\") pod \"1818648a-354a-43a7-8bd1-11a3ad76ed75\" (UID: \"1818648a-354a-43a7-8bd1-11a3ad76ed75\") " Sep 05 02:38:00.578882 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578844 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:38:00.578978 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.578943 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:38:00.581157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.581129 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-kube-api-access-c5jws" (OuterVolumeSpecName: "kube-api-access-c5jws") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "kube-api-access-c5jws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:38:00.581398 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.581372 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:38:00.581503 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.581437 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:38:00.581503 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.581462 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:38:00.581627 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.581510 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:38:00.588672 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.588630 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1818648a-354a-43a7-8bd1-11a3ad76ed75-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1818648a-354a-43a7-8bd1-11a3ad76ed75" (UID: "1818648a-354a-43a7-8bd1-11a3ad76ed75"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:38:00.679998 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.679960 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-installation-pull-secrets\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.679998 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.679995 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-certificates\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.680246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.680010 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5jws\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-kube-api-access-c5jws\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.680246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.680026 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1818648a-354a-43a7-8bd1-11a3ad76ed75-image-registry-private-configuration\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.680246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.680037 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-bound-sa-token\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.680246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.680045 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1818648a-354a-43a7-8bd1-11a3ad76ed75-ca-trust-extracted\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.680246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.680055 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1818648a-354a-43a7-8bd1-11a3ad76ed75-registry-tls\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.680246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.680063 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1818648a-354a-43a7-8bd1-11a3ad76ed75-trusted-ca\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:00.830462 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.830425 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-6mrxp"] Sep 05 02:38:00.830748 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.830734 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1818648a-354a-43a7-8bd1-11a3ad76ed75" containerName="registry" Sep 05 02:38:00.830813 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.830750 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1818648a-354a-43a7-8bd1-11a3ad76ed75" containerName="registry" Sep 05 02:38:00.830813 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.830812 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1818648a-354a-43a7-8bd1-11a3ad76ed75" containerName="registry" Sep 05 02:38:00.835757 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.835726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:00.837985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.837960 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 05 02:38:00.838097 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.837985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8twr7\"" Sep 05 02:38:00.838097 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.837962 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 05 02:38:00.845282 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.845251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-6mrxp"] Sep 05 02:38:00.853139 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.853114 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:00.881896 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.881870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwp9j\" (UniqueName: \"kubernetes.io/projected/414c553a-5df4-4526-ae1e-b3438ab7b3da-kube-api-access-wwp9j\") pod \"downloads-85d98c998f-6mrxp\" (UID: \"414c553a-5df4-4526-ae1e-b3438ab7b3da\") " pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:00.983234 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.983193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwp9j\" (UniqueName: \"kubernetes.io/projected/414c553a-5df4-4526-ae1e-b3438ab7b3da-kube-api-access-wwp9j\") pod \"downloads-85d98c998f-6mrxp\" (UID: \"414c553a-5df4-4526-ae1e-b3438ab7b3da\") " pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:00.987699 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.987657 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:00.994459 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:00.994429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwp9j\" (UniqueName: \"kubernetes.io/projected/414c553a-5df4-4526-ae1e-b3438ab7b3da-kube-api-access-wwp9j\") pod \"downloads-85d98c998f-6mrxp\" (UID: \"414c553a-5df4-4526-ae1e-b3438ab7b3da\") " pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:01.080601 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.080508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:01.146575 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.146538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:01.180268 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.180236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:01.358433 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.358348 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" Sep 05 02:38:01.358433 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.358358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9dcb6b888-24mhq" event={"ID":"1818648a-354a-43a7-8bd1-11a3ad76ed75","Type":"ContainerDied","Data":"33755113bcf92ef27faa1d6ee1bd75ac9ddb53be7b66a5d751337622ba3fd50d"} Sep 05 02:38:01.358433 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.358423 2577 scope.go:117] "RemoveContainer" containerID="f2f560b9f927e31fbb4d36d3f5d49a61f1af7efd0161ae7f18c1354dba8eceaf" Sep 05 02:38:01.384091 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.384035 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9dcb6b888-24mhq"] Sep 05 02:38:01.391561 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.391523 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:01.391884 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.391865 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9dcb6b888-24mhq"] Sep 05 02:38:01.428798 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.428777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-6mrxp"] Sep 05 02:38:01.595796 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.595764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:01.711294 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.711184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:01.868135 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:01.868106 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1818648a-354a-43a7-8bd1-11a3ad76ed75" path="/var/lib/kubelet/pods/1818648a-354a-43a7-8bd1-11a3ad76ed75/volumes" Sep 05 02:38:02.365533 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:02.365492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-6mrxp" event={"ID":"414c553a-5df4-4526-ae1e-b3438ab7b3da","Type":"ContainerStarted","Data":"1a4e5b4b816acf903ef85d3d2fffef99db2f11273bc1d52b30452c265f53cc22"} Sep 05 02:38:02.433124 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:02.433079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:02.529437 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:02.529405 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:02.645185 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:02.645102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:02.753846 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:02.753806 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:03.109479 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:03.109387 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:03.844011 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:03.843961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:03.941158 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:03.941115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:05.223927 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:05.223876 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:05.344017 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:05.343983 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:06.247393 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:06.247354 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:06.361137 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:06.361098 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:09.929905 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.929871 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5fc555d6-4l7db"] Sep 05 02:38:09.981373 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.981340 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5fc555d6-4l7db"] Sep 05 02:38:09.981537 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.981475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:09.985573 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.985542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 05 02:38:09.985573 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.985566 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 05 02:38:09.985944 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.985915 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 05 02:38:09.986244 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.986224 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 05 02:38:09.986330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.986248 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 05 02:38:09.986330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:09.986257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lkvdl\"" Sep 05 02:38:10.066171 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.066126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-serving-cert\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.066331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.066186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-oauth-serving-cert\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.066331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.066217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-service-ca\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.066331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.066258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8tt\" (UniqueName: \"kubernetes.io/projected/7ecf9297-a779-40c3-bb5f-9c11220f1294-kube-api-access-wv8tt\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.066331 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.066291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-oauth-config\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.066508 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.066342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-config\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.166900 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.166857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-serving-cert\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.166900 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.166904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-oauth-serving-cert\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.167133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.166927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-service-ca\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.167133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.166953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8tt\" (UniqueName: \"kubernetes.io/projected/7ecf9297-a779-40c3-bb5f-9c11220f1294-kube-api-access-wv8tt\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.167133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.166984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-oauth-config\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.167133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.167021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-config\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.167910 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.167885 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-oauth-serving-cert\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.168030 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.167911 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-config\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.168030 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.167918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-service-ca\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.170265 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.170241 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-oauth-config\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.170377 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.170252 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-serving-cert\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.178576 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.178554 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8tt\" (UniqueName: \"kubernetes.io/projected/7ecf9297-a779-40c3-bb5f-9c11220f1294-kube-api-access-wv8tt\") pod \"console-6b5fc555d6-4l7db\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.293396 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.293313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:10.599767 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.599736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5fc555d6-4l7db"] Sep 05 02:38:10.784011 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.783975 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:10.881389 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:10.881308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:14.247186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:14.247152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2t4m9" Sep 05 02:38:14.717074 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:14.717031 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:14.818146 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:14.818106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:14.879156 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:14.879117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:15.161666 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:15.161605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:15.322766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:15.322716 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:17.362473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.362437 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fb79f8cdd-rhg5t"] Sep 05 02:38:17.376863 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.376836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.384386 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.384354 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb79f8cdd-rhg5t"] Sep 05 02:38:17.387021 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.386989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 05 02:38:17.543725 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.543683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-serving-cert\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.543725 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.543733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-service-ca\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.543972 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.543824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-config\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.543972 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.543864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8dks\" (UniqueName: \"kubernetes.io/projected/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-kube-api-access-f8dks\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.543972 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.543967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-oauth-serving-cert\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.544128 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.544005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-oauth-config\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.544128 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.544043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-trusted-ca-bundle\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.616009 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:38:17.615934 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecf9297_a779_40c3_bb5f_9c11220f1294.slice/crio-8062399e366729eb39d530acfe21df2429c95a4adbda3e7adebc5732ff48ddb1 WatchSource:0}: Error finding container 8062399e366729eb39d530acfe21df2429c95a4adbda3e7adebc5732ff48ddb1: Status 404 returned error can't find the container with id 8062399e366729eb39d530acfe21df2429c95a4adbda3e7adebc5732ff48ddb1 Sep 05 02:38:17.645449 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-config\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.645615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8dks\" (UniqueName: \"kubernetes.io/projected/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-kube-api-access-f8dks\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.645615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-oauth-serving-cert\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.645615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-oauth-config\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.645615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-trusted-ca-bundle\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.645615 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-serving-cert\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.645910 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.645633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-service-ca\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.646365 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.646304 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-config\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.646481 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.646458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-oauth-serving-cert\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.646562 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.646538 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-service-ca\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.646600 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.646558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-trusted-ca-bundle\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.648211 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.648193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-serving-cert\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.648281 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.648224 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-oauth-config\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.657033 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.657014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8dks\" (UniqueName: \"kubernetes.io/projected/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-kube-api-access-f8dks\") pod \"console-6fb79f8cdd-rhg5t\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.690374 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.690346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:17.977061 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:17.976846 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fb79f8cdd-rhg5t"] Sep 05 02:38:17.979533 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:38:17.979500 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd403b68c_58f5_4dc2_bc50_86a0345cb5ed.slice/crio-e21bc1da291c9465e835f44222e0a8c3ed19abf028c04ebdb96610681c65fdf0 WatchSource:0}: Error finding container e21bc1da291c9465e835f44222e0a8c3ed19abf028c04ebdb96610681c65fdf0: Status 404 returned error can't find the container with id e21bc1da291c9465e835f44222e0a8c3ed19abf028c04ebdb96610681c65fdf0 Sep 05 02:38:18.193001 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.192973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:18.301007 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.300911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:18.436895 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.436822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-6mrxp" event={"ID":"414c553a-5df4-4526-ae1e-b3438ab7b3da","Type":"ContainerStarted","Data":"80b39f1403bc0c0b1604b76fc437917eec83c88030b2223caab0e0cc90227d97"} Sep 05 02:38:18.438056 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.437592 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:18.440789 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.440763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5fc555d6-4l7db" event={"ID":"7ecf9297-a779-40c3-bb5f-9c11220f1294","Type":"ContainerStarted","Data":"8062399e366729eb39d530acfe21df2429c95a4adbda3e7adebc5732ff48ddb1"} Sep 05 02:38:18.442705 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.442675 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb79f8cdd-rhg5t" event={"ID":"d403b68c-58f5-4dc2-bc50-86a0345cb5ed","Type":"ContainerStarted","Data":"e21bc1da291c9465e835f44222e0a8c3ed19abf028c04ebdb96610681c65fdf0"} Sep 05 02:38:18.446316 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.446274 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-6mrxp" Sep 05 02:38:18.460216 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:18.459893 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-6mrxp" podStartSLOduration=1.9030341 podStartE2EDuration="18.459878192s" totalImagesPullingTime="16.556844092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:38:18.459508921 +0000 UTC m=+111.074899917" watchObservedRunningTime="2026-09-05 02:38:18.459878192 +0000 UTC m=+111.075269185" Sep 05 02:38:20.241849 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:20.241812 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:20.372416 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:20.372366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:21.007140 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:21.007099 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:21.131553 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:21.131520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:21.621853 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:21.621807 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/init-config-reloader/0.log" Sep 05 02:38:21.633934 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:21.633874 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/alertmanager/0.log" Sep 05 02:38:21.777250 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:21.777215 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/config-reloader/0.log" Sep 05 02:38:22.009553 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.009518 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/kube-rbac-proxy-web/0.log" Sep 05 02:38:22.175164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.175127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/kube-rbac-proxy/0.log" Sep 05 02:38:22.377249 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.377218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/kube-rbac-proxy-metric/0.log" Sep 05 02:38:22.472254 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.472162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5fc555d6-4l7db" event={"ID":"7ecf9297-a779-40c3-bb5f-9c11220f1294","Type":"ContainerStarted","Data":"a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d"} Sep 05 02:38:22.474129 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.474101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb79f8cdd-rhg5t" event={"ID":"d403b68c-58f5-4dc2-bc50-86a0345cb5ed","Type":"ContainerStarted","Data":"2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476"} Sep 05 02:38:22.498104 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.498043 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b5fc555d6-4l7db" podStartSLOduration=9.036443113 podStartE2EDuration="13.498019121s" totalImagesPullingTime="4.461576008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:38:22.496512518 +0000 UTC m=+115.111903513" watchObservedRunningTime="2026-09-05 02:38:22.498019121 +0000 UTC m=+115.113410118" Sep 05 02:38:22.528012 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.527951 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fb79f8cdd-rhg5t" podStartSLOduration=1.42287809 podStartE2EDuration="5.527930537s" totalImagesPullingTime="4.105052447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:38:22.526209073 +0000 UTC m=+115.141600070" watchObservedRunningTime="2026-09-05 02:38:22.527930537 +0000 UTC m=+115.143321536" Sep 05 02:38:22.575013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.574981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6322b0d3-7f36-4927-b34f-e96f7025b89a/prom-label-proxy/0.log" Sep 05 02:38:22.977801 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:22.977769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwr9p_0d454a88-0042-44f3-a24b-512ee8748739/kube-state-metrics/0.log" Sep 05 02:38:23.176525 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:23.176493 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwr9p_0d454a88-0042-44f3-a24b-512ee8748739/kube-rbac-proxy-main/0.log" Sep 05 02:38:23.377228 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:23.377195 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwr9p_0d454a88-0042-44f3-a24b-512ee8748739/kube-rbac-proxy-self/0.log" Sep 05 02:38:24.185238 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:24.185201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:24.292076 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:24.292038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:25.175983 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:25.175950 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkqz7_57aa1c20-6894-420c-b023-4aabe1680c9e/init-textfile/0.log" Sep 05 02:38:25.376466 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:25.376431 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkqz7_57aa1c20-6894-420c-b023-4aabe1680c9e/node-exporter/0.log" Sep 05 02:38:25.578766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:25.578736 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkqz7_57aa1c20-6894-420c-b023-4aabe1680c9e/kube-rbac-proxy/0.log" Sep 05 02:38:27.691285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:27.691244 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:27.691700 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:27.691309 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:27.695955 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:27.695935 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:27.775982 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:27.775954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fg2hz_7b30bf5e-6a07-48c5-86f0-477b43a2086e/prometheus-operator/0.log" Sep 05 02:38:27.974233 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:27.974156 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fg2hz_7b30bf5e-6a07-48c5-86f0-477b43a2086e/kube-rbac-proxy/0.log" Sep 05 02:38:28.377683 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.377656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/thanos-query/0.log" Sep 05 02:38:28.502568 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.502536 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:38:28.570150 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.570115 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5fc555d6-4l7db"] Sep 05 02:38:28.584013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.583985 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy-web/0.log" Sep 05 02:38:28.746826 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.746742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:28.774608 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.774578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy/0.log" Sep 05 02:38:28.892434 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.892398 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:28.966424 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.966393 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:28.974658 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:28.974620 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/prom-label-proxy/0.log" Sep 05 02:38:29.176174 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:29.176151 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy-rules/0.log" Sep 05 02:38:29.375251 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:29.375219 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy-metrics/0.log" Sep 05 02:38:29.575474 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:29.575451 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-489nn_0a01e8a2-87d5-45d4-b149-c5fbb9316231/networking-console-plugin/0.log" Sep 05 02:38:29.701369 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:29.701332 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:29.988099 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:29.988013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:30.178132 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:30.178105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5fc555d6-4l7db_7ecf9297-a779-40c3-bb5f-9c11220f1294/console/0.log" Sep 05 02:38:30.293605 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:30.293525 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:30.375756 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:30.375723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fb79f8cdd-rhg5t_d403b68c-58f5-4dc2-bc50-86a0345cb5ed/console/0.log" Sep 05 02:38:30.581981 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:30.581956 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-6mrxp_414c553a-5df4-4526-ae1e-b3438ab7b3da/download-server/0.log" Sep 05 02:38:35.187437 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:35.187381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:35.285085 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:35.285050 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:50.180364 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:50.180324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:50.280572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:50.280545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:38:53.590367 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.590302 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b5fc555d6-4l7db" podUID="7ecf9297-a779-40c3-bb5f-9c11220f1294" containerName="console" containerID="cri-o://a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d" gracePeriod=15 Sep 05 02:38:53.865081 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.865018 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:53.948847 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.948822 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-serving-cert\") pod \"7ecf9297-a779-40c3-bb5f-9c11220f1294\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " Sep 05 02:38:53.948989 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.948857 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv8tt\" (UniqueName: \"kubernetes.io/projected/7ecf9297-a779-40c3-bb5f-9c11220f1294-kube-api-access-wv8tt\") pod \"7ecf9297-a779-40c3-bb5f-9c11220f1294\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " Sep 05 02:38:53.949043 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.948993 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-oauth-config\") pod \"7ecf9297-a779-40c3-bb5f-9c11220f1294\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " Sep 05 02:38:53.949100 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.949039 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-oauth-serving-cert\") pod \"7ecf9297-a779-40c3-bb5f-9c11220f1294\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " Sep 05 02:38:53.949100 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.949068 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-service-ca\") pod \"7ecf9297-a779-40c3-bb5f-9c11220f1294\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " Sep 05 02:38:53.949204 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.949098 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-config\") pod \"7ecf9297-a779-40c3-bb5f-9c11220f1294\" (UID: \"7ecf9297-a779-40c3-bb5f-9c11220f1294\") " Sep 05 02:38:53.949482 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.949454 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ecf9297-a779-40c3-bb5f-9c11220f1294" (UID: "7ecf9297-a779-40c3-bb5f-9c11220f1294"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:38:53.949482 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.949462 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ecf9297-a779-40c3-bb5f-9c11220f1294" (UID: "7ecf9297-a779-40c3-bb5f-9c11220f1294"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:38:53.949827 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.949466 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-config" (OuterVolumeSpecName: "console-config") pod "7ecf9297-a779-40c3-bb5f-9c11220f1294" (UID: "7ecf9297-a779-40c3-bb5f-9c11220f1294"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:38:53.951227 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.951204 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ecf9297-a779-40c3-bb5f-9c11220f1294" (UID: "7ecf9297-a779-40c3-bb5f-9c11220f1294"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:38:53.951306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.951256 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ecf9297-a779-40c3-bb5f-9c11220f1294" (UID: "7ecf9297-a779-40c3-bb5f-9c11220f1294"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:38:53.951306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:53.951266 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ecf9297-a779-40c3-bb5f-9c11220f1294-kube-api-access-wv8tt" (OuterVolumeSpecName: "kube-api-access-wv8tt") pod "7ecf9297-a779-40c3-bb5f-9c11220f1294" (UID: "7ecf9297-a779-40c3-bb5f-9c11220f1294"). InnerVolumeSpecName "kube-api-access-wv8tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:38:54.050036 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.050014 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-oauth-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:54.050036 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.050034 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-oauth-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:54.050166 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.050046 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-service-ca\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:54.050166 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.050054 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:54.050166 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.050061 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecf9297-a779-40c3-bb5f-9c11220f1294-console-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:54.050166 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.050069 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8tt\" (UniqueName: \"kubernetes.io/projected/7ecf9297-a779-40c3-bb5f-9c11220f1294-kube-api-access-wv8tt\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:38:54.606510 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.606480 2577 generic.go:356] "Generic (PLEG): container finished" podID="7ecf9297-a779-40c3-bb5f-9c11220f1294" containerID="a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d" exitCode=0 Sep 05 02:38:54.607005 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.606531 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5fc555d6-4l7db" Sep 05 02:38:54.607005 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.606543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5fc555d6-4l7db" event={"ID":"7ecf9297-a779-40c3-bb5f-9c11220f1294","Type":"ContainerDied","Data":"a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d"} Sep 05 02:38:54.607005 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.606583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5fc555d6-4l7db" event={"ID":"7ecf9297-a779-40c3-bb5f-9c11220f1294","Type":"ContainerDied","Data":"8062399e366729eb39d530acfe21df2429c95a4adbda3e7adebc5732ff48ddb1"} Sep 05 02:38:54.607005 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.606601 2577 scope.go:117] "RemoveContainer" containerID="a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d" Sep 05 02:38:54.615338 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.615315 2577 scope.go:117] "RemoveContainer" containerID="a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d" Sep 05 02:38:54.615612 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:38:54.615587 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d\": container with ID starting with a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d not found: ID does not exist" containerID="a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d" Sep 05 02:38:54.615721 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.615622 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d"} err="failed to get container status \"a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d\": rpc error: code = NotFound desc = could not find container \"a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d\": container with ID starting with a59a1ca8ec9ac4aeae67870251b0802697989b2546d69c4568d2bc6983d32b3d not found: ID does not exist" Sep 05 02:38:54.628868 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.628848 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5fc555d6-4l7db"] Sep 05 02:38:54.633521 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:54.633503 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5fc555d6-4l7db"] Sep 05 02:38:55.868502 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:38:55.868470 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ecf9297-a779-40c3-bb5f-9c11220f1294" path="/var/lib/kubelet/pods/7ecf9297-a779-40c3-bb5f-9c11220f1294/volumes" Sep 05 02:39:00.532055 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:00.532019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:06.740545 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:06.740513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:07.043677 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.043571 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:07.803030 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.802995 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:39:07.803434 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.803320 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="alertmanager" containerID="cri-o://c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a" gracePeriod=120 Sep 05 02:39:07.803434 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.803373 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-metric" containerID="cri-o://9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90" gracePeriod=120 Sep 05 02:39:07.803545 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.803425 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy" containerID="cri-o://d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2" gracePeriod=120 Sep 05 02:39:07.803545 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.803450 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="config-reloader" containerID="cri-o://51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255" gracePeriod=120 Sep 05 02:39:07.803545 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.803425 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-web" containerID="cri-o://790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba" gracePeriod=120 Sep 05 02:39:07.803727 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:07.803670 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="prom-label-proxy" containerID="cri-o://5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd" gracePeriod=120 Sep 05 02:39:08.667015 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.666983 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd" exitCode=0 Sep 05 02:39:08.667015 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667007 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2" exitCode=0 Sep 05 02:39:08.667015 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667013 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255" exitCode=0 Sep 05 02:39:08.667015 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667018 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a" exitCode=0 Sep 05 02:39:08.667278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667044 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd"} Sep 05 02:39:08.667278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2"} Sep 05 02:39:08.667278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255"} Sep 05 02:39:08.667278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:08.667143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a"} Sep 05 02:39:09.042737 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.042711 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.162812 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162780 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-main-tls\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162821 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-main-db\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162848 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-web-config\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162872 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-out\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162891 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-cluster-tls-config\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162911 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-volume\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162932 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-trusted-ca-bundle\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.162973 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162947 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-tls-assets\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.163319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.162991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.163319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163024 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcn24\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-kube-api-access-mcn24\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.163319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163049 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-web\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.163319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163084 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.163319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163110 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-metrics-client-ca\") pod \"6322b0d3-7f36-4927-b34f-e96f7025b89a\" (UID: \"6322b0d3-7f36-4927-b34f-e96f7025b89a\") " Sep 05 02:39:09.163319 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163164 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:39:09.163603 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163403 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-main-db\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.163603 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163382 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:39:09.163945 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.163685 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:39:09.165779 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.165733 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.166043 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.166013 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-out" (OuterVolumeSpecName: "config-out") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:39:09.166538 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.166502 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-volume" (OuterVolumeSpecName: "config-volume") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.166817 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.166779 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-kube-api-access-mcn24" (OuterVolumeSpecName: "kube-api-access-mcn24") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "kube-api-access-mcn24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:39:09.166916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.166815 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.167073 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.167046 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.167609 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.167590 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:39:09.167709 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.167680 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.170611 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.170590 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.177487 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.177464 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-web-config" (OuterVolumeSpecName: "web-config") pod "6322b0d3-7f36-4927-b34f-e96f7025b89a" (UID: "6322b0d3-7f36-4927-b34f-e96f7025b89a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:09.264768 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264728 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-main-tls\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264768 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264765 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-web-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264768 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264778 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-out\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264789 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-cluster-tls-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264804 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-config-volume\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264815 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264826 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-tls-assets\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264837 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264850 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcn24\" (UniqueName: \"kubernetes.io/projected/6322b0d3-7f36-4927-b34f-e96f7025b89a-kube-api-access-mcn24\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264862 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264875 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6322b0d3-7f36-4927-b34f-e96f7025b89a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.264985 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.264888 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6322b0d3-7f36-4927-b34f-e96f7025b89a-metrics-client-ca\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:09.395002 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.394969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:09.673916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.673885 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90" exitCode=0 Sep 05 02:39:09.673916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.673908 2577 generic.go:356] "Generic (PLEG): container finished" podID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerID="790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba" exitCode=0 Sep 05 02:39:09.674121 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.673943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90"} Sep 05 02:39:09.674121 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.673960 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.674121 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.674008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba"} Sep 05 02:39:09.674121 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.674037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6322b0d3-7f36-4927-b34f-e96f7025b89a","Type":"ContainerDied","Data":"367cbe3eec643404237f7e3a75d3cf45b1c7e5ae9ff1255d10a04a0e735c2aae"} Sep 05 02:39:09.674121 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.674064 2577 scope.go:117] "RemoveContainer" containerID="5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd" Sep 05 02:39:09.682009 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.681987 2577 scope.go:117] "RemoveContainer" containerID="9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90" Sep 05 02:39:09.689478 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.689456 2577 scope.go:117] "RemoveContainer" containerID="d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2" Sep 05 02:39:09.695868 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.695853 2577 scope.go:117] "RemoveContainer" containerID="790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba" Sep 05 02:39:09.699820 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.699797 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:39:09.702809 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.702793 2577 scope.go:117] "RemoveContainer" containerID="51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255" Sep 05 02:39:09.706840 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.706821 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:39:09.709802 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.709787 2577 scope.go:117] "RemoveContainer" containerID="c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a" Sep 05 02:39:09.718977 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.718961 2577 scope.go:117] "RemoveContainer" containerID="b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0" Sep 05 02:39:09.725932 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.725916 2577 scope.go:117] "RemoveContainer" containerID="5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd" Sep 05 02:39:09.726214 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.726195 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd\": container with ID starting with 5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd not found: ID does not exist" containerID="5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd" Sep 05 02:39:09.726272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.726221 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd"} err="failed to get container status \"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd\": rpc error: code = NotFound desc = could not find container \"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd\": container with ID starting with 5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd not found: ID does not exist" Sep 05 02:39:09.726272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.726239 2577 scope.go:117] "RemoveContainer" containerID="9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90" Sep 05 02:39:09.726472 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.726457 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90\": container with ID starting with 9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90 not found: ID does not exist" containerID="9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90" Sep 05 02:39:09.726514 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.726476 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90"} err="failed to get container status \"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90\": rpc error: code = NotFound desc = could not find container \"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90\": container with ID starting with 9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90 not found: ID does not exist" Sep 05 02:39:09.726514 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.726490 2577 scope.go:117] "RemoveContainer" containerID="d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2" Sep 05 02:39:09.726735 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.726719 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2\": container with ID starting with d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2 not found: ID does not exist" containerID="d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2" Sep 05 02:39:09.726782 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.726738 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2"} err="failed to get container status \"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2\": rpc error: code = NotFound desc = could not find container \"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2\": container with ID starting with d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2 not found: ID does not exist" Sep 05 02:39:09.726782 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.726752 2577 scope.go:117] "RemoveContainer" containerID="790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba" Sep 05 02:39:09.727239 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.726934 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba\": container with ID starting with 790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba not found: ID does not exist" containerID="790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba" Sep 05 02:39:09.727313 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.727252 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba"} err="failed to get container status \"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba\": rpc error: code = NotFound desc = could not find container \"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba\": container with ID starting with 790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba not found: ID does not exist" Sep 05 02:39:09.727313 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.727274 2577 scope.go:117] "RemoveContainer" containerID="51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255" Sep 05 02:39:09.731583 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.731559 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255\": container with ID starting with 51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255 not found: ID does not exist" containerID="51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255" Sep 05 02:39:09.731694 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.731589 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255"} err="failed to get container status \"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255\": rpc error: code = NotFound desc = could not find container \"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255\": container with ID starting with 51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255 not found: ID does not exist" Sep 05 02:39:09.731694 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.731604 2577 scope.go:117] "RemoveContainer" containerID="c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a" Sep 05 02:39:09.731925 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.731904 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a\": container with ID starting with c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a not found: ID does not exist" containerID="c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a" Sep 05 02:39:09.731972 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.731931 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a"} err="failed to get container status \"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a\": rpc error: code = NotFound desc = could not find container \"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a\": container with ID starting with c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a not found: ID does not exist" Sep 05 02:39:09.731972 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.731946 2577 scope.go:117] "RemoveContainer" containerID="b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0" Sep 05 02:39:09.732220 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:09.732195 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0\": container with ID starting with b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0 not found: ID does not exist" containerID="b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0" Sep 05 02:39:09.732303 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732219 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0"} err="failed to get container status \"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0\": rpc error: code = NotFound desc = could not find container \"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0\": container with ID starting with b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0 not found: ID does not exist" Sep 05 02:39:09.732303 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732236 2577 scope.go:117] "RemoveContainer" containerID="5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd" Sep 05 02:39:09.732482 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732461 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd"} err="failed to get container status \"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd\": rpc error: code = NotFound desc = could not find container \"5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd\": container with ID starting with 5d9a04e37dcb80583711bd859ca3f5be680976f466e44631afe45f32835e38dd not found: ID does not exist" Sep 05 02:39:09.732524 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732483 2577 scope.go:117] "RemoveContainer" containerID="9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90" Sep 05 02:39:09.732719 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732702 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90"} err="failed to get container status \"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90\": rpc error: code = NotFound desc = could not find container \"9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90\": container with ID starting with 9b1ea3d43c3964bee54a1a510709b32c9c7ea6ea70a2d3823d135cb76d529f90 not found: ID does not exist" Sep 05 02:39:09.732773 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732720 2577 scope.go:117] "RemoveContainer" containerID="d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2" Sep 05 02:39:09.732986 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732960 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2"} err="failed to get container status \"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2\": rpc error: code = NotFound desc = could not find container \"d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2\": container with ID starting with d0969252bc2b065d69b35c0e76cda2608b1abe8c21fb63a0fcfd5acefbca41d2 not found: ID does not exist" Sep 05 02:39:09.733051 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.732995 2577 scope.go:117] "RemoveContainer" containerID="790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba" Sep 05 02:39:09.733344 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.733317 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba"} err="failed to get container status \"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba\": rpc error: code = NotFound desc = could not find container \"790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba\": container with ID starting with 790d593c47903cd385bbd4cc8eb9be37c0f3b764965e7ff1b884a0bebdc2b0ba not found: ID does not exist" Sep 05 02:39:09.733407 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.733351 2577 scope.go:117] "RemoveContainer" containerID="51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255" Sep 05 02:39:09.733711 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.733690 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255"} err="failed to get container status \"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255\": rpc error: code = NotFound desc = could not find container \"51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255\": container with ID starting with 51686831e2f3c91594fed7122cbe6a0ce535b78dacab3586074d1f89cae96255 not found: ID does not exist" Sep 05 02:39:09.733711 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.733711 2577 scope.go:117] "RemoveContainer" containerID="c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a" Sep 05 02:39:09.733997 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.733980 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a"} err="failed to get container status \"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a\": rpc error: code = NotFound desc = could not find container \"c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a\": container with ID starting with c03c8a1bbf19d90b664c68c3ad6aeb137729673f5c95729214b1e103d6e8554a not found: ID does not exist" Sep 05 02:39:09.733997 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.733996 2577 scope.go:117] "RemoveContainer" containerID="b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0" Sep 05 02:39:09.734224 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.734207 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0"} err="failed to get container status \"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0\": rpc error: code = NotFound desc = could not find container \"b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0\": container with ID starting with b861a8029f2b084db977126a5a75df88489b32d42b365b0dbf31a79242faf5a0 not found: ID does not exist" Sep 05 02:39:09.778267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778242 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:39:09.778673 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778657 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="alertmanager" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778677 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="alertmanager" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778690 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="config-reloader" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778698 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="config-reloader" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778703 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-web" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778709 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-web" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778722 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778727 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778742 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="prom-label-proxy" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778747 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="prom-label-proxy" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778756 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-metric" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778760 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-metric" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778766 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ecf9297-a779-40c3-bb5f-9c11220f1294" containerName="console" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778770 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ecf9297-a779-40c3-bb5f-9c11220f1294" containerName="console" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778777 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="init-config-reloader" Sep 05 02:39:09.778772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778782 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="init-config-reloader" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778831 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="config-reloader" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778839 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-web" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778845 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778850 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="kube-rbac-proxy-metric" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778856 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ecf9297-a779-40c3-bb5f-9c11220f1294" containerName="console" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778861 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="alertmanager" Sep 05 02:39:09.779347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.778866 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" containerName="prom-label-proxy" Sep 05 02:39:09.782603 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.782586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.788775 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.788752 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 05 02:39:09.788874 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.788781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 05 02:39:09.788874 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.788815 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g6t2f\"" Sep 05 02:39:09.790448 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.790262 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 05 02:39:09.790537 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.790262 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 05 02:39:09.790854 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.790836 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 05 02:39:09.791112 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.791093 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 05 02:39:09.791208 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.791107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 05 02:39:09.791256 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.791234 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 05 02:39:09.800311 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.800290 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 05 02:39:09.819412 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.819385 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:39:09.868411 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-config-volume\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868411 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b93a7d-f77d-4013-9788-4c9d7a8866de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70b93a7d-f77d-4013-9788-4c9d7a8866de-config-out\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70b93a7d-f77d-4013-9788-4c9d7a8866de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnv6\" (UniqueName: \"kubernetes.io/projected/70b93a7d-f77d-4013-9788-4c9d7a8866de-kube-api-access-9cnv6\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-web-config\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b93a7d-f77d-4013-9788-4c9d7a8866de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70b93a7d-f77d-4013-9788-4c9d7a8866de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868766 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.868966 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.868783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.869538 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.869511 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6322b0d3-7f36-4927-b34f-e96f7025b89a" path="/var/lib/kubelet/pods/6322b0d3-7f36-4927-b34f-e96f7025b89a/volumes" Sep 05 02:39:09.969174 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b93a7d-f77d-4013-9788-4c9d7a8866de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969174 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969174 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70b93a7d-f77d-4013-9788-4c9d7a8866de-config-out\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70b93a7d-f77d-4013-9788-4c9d7a8866de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnv6\" (UniqueName: \"kubernetes.io/projected/70b93a7d-f77d-4013-9788-4c9d7a8866de-kube-api-access-9cnv6\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-web-config\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b93a7d-f77d-4013-9788-4c9d7a8866de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.969413 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70b93a7d-f77d-4013-9788-4c9d7a8866de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.970568 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.970568 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.970568 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.969522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-config-volume\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.970849 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.970824 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70b93a7d-f77d-4013-9788-4c9d7a8866de-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.971009 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.970957 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b93a7d-f77d-4013-9788-4c9d7a8866de-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.971112 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.971047 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b93a7d-f77d-4013-9788-4c9d7a8866de-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.972601 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.972566 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.972838 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.972791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-config-volume\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.973388 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.973350 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70b93a7d-f77d-4013-9788-4c9d7a8866de-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.973474 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.973411 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.973681 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.973629 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.973894 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.973863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.974323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.974304 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70b93a7d-f77d-4013-9788-4c9d7a8866de-config-out\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.974802 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.974781 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-web-config\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.975169 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.975154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70b93a7d-f77d-4013-9788-4c9d7a8866de-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:09.979536 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:09.979519 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnv6\" (UniqueName: \"kubernetes.io/projected/70b93a7d-f77d-4013-9788-4c9d7a8866de-kube-api-access-9cnv6\") pod \"alertmanager-main-0\" (UID: \"70b93a7d-f77d-4013-9788-4c9d7a8866de\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:10.092932 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:10.092896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:39:10.383474 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:10.383449 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:39:10.385400 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:39:10.385372 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b93a7d_f77d_4013_9788_4c9d7a8866de.slice/crio-14acaeb2ccde9ac2622e3179144d2f1d7e026a23e69ecb6aa353eb4fc2ce4f27 WatchSource:0}: Error finding container 14acaeb2ccde9ac2622e3179144d2f1d7e026a23e69ecb6aa353eb4fc2ce4f27: Status 404 returned error can't find the container with id 14acaeb2ccde9ac2622e3179144d2f1d7e026a23e69ecb6aa353eb4fc2ce4f27 Sep 05 02:39:10.551621 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:10.551588 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:10.679774 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:10.679681 2577 generic.go:356] "Generic (PLEG): container finished" podID="70b93a7d-f77d-4013-9788-4c9d7a8866de" containerID="b21d017dbff13eaaf400fd186428d15eeaa755c2ec068d1ad33e44513de822b0" exitCode=0 Sep 05 02:39:10.679937 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:10.679776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerDied","Data":"b21d017dbff13eaaf400fd186428d15eeaa755c2ec068d1ad33e44513de822b0"} Sep 05 02:39:10.679937 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:10.679853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"14acaeb2ccde9ac2622e3179144d2f1d7e026a23e69ecb6aa353eb4fc2ce4f27"} Sep 05 02:39:11.688848 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.688814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"f559a64cdb68c618645ae6ca1b4c53d3413c92e96e2121d5094d5e96f39579b3"} Sep 05 02:39:11.689275 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.688906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"b1622d6e7c55954eb0c785ab536ed99627a898956d59c21be4a26acaa193bee7"} Sep 05 02:39:11.689275 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.688933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"8879f24b3164a4d594030fe95c45d96750cf1b0192ac2664c03366dd57b1c920"} Sep 05 02:39:11.689275 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.688957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"ed1979d67a18cde1340b19e2a84742d4bade44f98e2b022569dc3f288bef7bda"} Sep 05 02:39:11.689275 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.688978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"b78d53e5282ffe3b9e49de467b261662cfa4102235cef6bcdcd181d64a08bbd5"} Sep 05 02:39:11.689275 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.689001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70b93a7d-f77d-4013-9788-4c9d7a8866de","Type":"ContainerStarted","Data":"7bf1f4f663bcfc9ff7293180b9d4a9e8b9aa1fe8e9591480c866c763cae0eed1"} Sep 05 02:39:11.716700 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.716630 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.698562477 podStartE2EDuration="2.71661525s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.052773ms" isStatefulPod=false podCreationTimestamp="2026-09-05 02:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:39:11.715935597 +0000 UTC m=+164.331326592" watchObservedRunningTime="2026-09-05 02:39:11.71661525 +0000 UTC m=+164.332006438" Sep 05 02:39:11.832830 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.832792 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5496dc49fc-r46xb"] Sep 05 02:39:11.835786 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.835766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.838853 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.838827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 05 02:39:11.838995 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.838903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 05 02:39:11.840945 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.840924 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 05 02:39:11.841105 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.841079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 05 02:39:11.841237 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.841180 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 05 02:39:11.841403 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.841378 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-45j8z\"" Sep 05 02:39:11.847264 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.847244 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 05 02:39:11.871570 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.871546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5496dc49fc-r46xb"] Sep 05 02:39:11.985190 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-secret-telemeter-client\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985190 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985190 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz6x6\" (UniqueName: \"kubernetes.io/projected/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-kube-api-access-kz6x6\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-federate-client-tls\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-serving-certs-ca-bundle\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-telemeter-client-tls\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-metrics-client-ca\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:11.985452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:11.985371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz6x6\" (UniqueName: \"kubernetes.io/projected/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-kube-api-access-kz6x6\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086729 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-federate-client-tls\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086729 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-serving-certs-ca-bundle\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086729 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-telemeter-client-tls\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086729 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-metrics-client-ca\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086729 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.086729 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.086604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-secret-telemeter-client\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.087624 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.087593 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.087788 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.087767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-serving-certs-ca-bundle\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.087939 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.087913 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-metrics-client-ca\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.089531 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.089504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-federate-client-tls\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.089681 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.089558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-telemeter-client-tls\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.090025 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.089999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-secret-telemeter-client\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.090246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.090200 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.095927 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.095903 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz6x6\" (UniqueName: \"kubernetes.io/projected/55d4fd54-b481-4103-a1b3-ffe7cdfdd474-kube-api-access-kz6x6\") pod \"telemeter-client-5496dc49fc-r46xb\" (UID: \"55d4fd54-b481-4103-a1b3-ffe7cdfdd474\") " pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.148382 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.148350 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" Sep 05 02:39:12.428932 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.428849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5496dc49fc-r46xb"] Sep 05 02:39:12.433617 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:39:12.433587 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d4fd54_b481_4103_a1b3_ffe7cdfdd474.slice/crio-35e2f37bbd87eedd65ea4f52da1a0ef854a403873bb358743c43b5722792eec1 WatchSource:0}: Error finding container 35e2f37bbd87eedd65ea4f52da1a0ef854a403873bb358743c43b5722792eec1: Status 404 returned error can't find the container with id 35e2f37bbd87eedd65ea4f52da1a0ef854a403873bb358743c43b5722792eec1 Sep 05 02:39:12.694723 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:12.694619 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" event={"ID":"55d4fd54-b481-4103-a1b3-ffe7cdfdd474","Type":"ContainerStarted","Data":"35e2f37bbd87eedd65ea4f52da1a0ef854a403873bb358743c43b5722792eec1"} Sep 05 02:39:14.706878 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.706804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" event={"ID":"55d4fd54-b481-4103-a1b3-ffe7cdfdd474","Type":"ContainerStarted","Data":"48de42251281f1babbe35443d25e89c66eb9be32d9ec81bbbfde26e466d57f2f"} Sep 05 02:39:14.707227 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.706889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" event={"ID":"55d4fd54-b481-4103-a1b3-ffe7cdfdd474","Type":"ContainerStarted","Data":"99a0e1f035f4309ac6c92353029ee1eedd676001dac008dd6aabb922e03c5684"} Sep 05 02:39:14.707227 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.706908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" event={"ID":"55d4fd54-b481-4103-a1b3-ffe7cdfdd474","Type":"ContainerStarted","Data":"4831b78842b8a10f229a9b6163fbc45eb6152d9bd9e1e5e851df5f556d2bc37e"} Sep 05 02:39:14.735662 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.735593 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5496dc49fc-r46xb" podStartSLOduration=1.81293776 podStartE2EDuration="3.735572965s" totalImagesPullingTime="1.922635205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:39:14.734061009 +0000 UTC m=+167.349452005" watchObservedRunningTime="2026-09-05 02:39:14.735572965 +0000 UTC m=+167.350963963" Sep 05 02:39:14.843144 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.843101 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8bdfc4f7-68mr4"] Sep 05 02:39:14.845631 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.845599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:14.859942 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.859920 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8bdfc4f7-68mr4"] Sep 05 02:39:14.917666 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:14.917614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:15.010315 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-config\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.010315 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-service-ca\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.010315 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-serving-cert\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.010597 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mngc\" (UniqueName: \"kubernetes.io/projected/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-kube-api-access-9mngc\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.010597 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-trusted-ca-bundle\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.010721 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-oauth-serving-cert\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.010721 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.010636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-oauth-config\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.019867 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.019844 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:15.111106 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-trusted-ca-bundle\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.111273 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-oauth-serving-cert\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.111273 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-oauth-config\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.111273 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-config\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.111273 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-service-ca\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.111458 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-serving-cert\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.111458 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mngc\" (UniqueName: \"kubernetes.io/projected/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-kube-api-access-9mngc\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.112000 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.111970 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-oauth-serving-cert\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.112242 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.112219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-config\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.112242 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.112234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-service-ca\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.112336 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.112268 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-trusted-ca-bundle\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.113740 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.113718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-oauth-config\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.114229 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.114186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-serving-cert\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.119607 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.119544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:15.122984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.122962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mngc\" (UniqueName: \"kubernetes.io/projected/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-kube-api-access-9mngc\") pod \"console-7d8bdfc4f7-68mr4\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.155965 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.155935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:15.219246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.219222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:15.431516 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.431489 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8bdfc4f7-68mr4"] Sep 05 02:39:15.434294 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:39:15.434268 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc781411a_6675_4eac_9dd7_b7d9eb71fb6f.slice/crio-5f3a232439ddfd066d3b15267bdfecd78adf75919b438e7545b23b27310f0d8d WatchSource:0}: Error finding container 5f3a232439ddfd066d3b15267bdfecd78adf75919b438e7545b23b27310f0d8d: Status 404 returned error can't find the container with id 5f3a232439ddfd066d3b15267bdfecd78adf75919b438e7545b23b27310f0d8d Sep 05 02:39:15.634189 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.634155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:15.687539 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.687468 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:15.712305 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.712271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bdfc4f7-68mr4" event={"ID":"c781411a-6675-4eac-9dd7-b7d9eb71fb6f","Type":"ContainerStarted","Data":"33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2"} Sep 05 02:39:15.712676 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.712329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bdfc4f7-68mr4" event={"ID":"c781411a-6675-4eac-9dd7-b7d9eb71fb6f","Type":"ContainerStarted","Data":"5f3a232439ddfd066d3b15267bdfecd78adf75919b438e7545b23b27310f0d8d"} Sep 05 02:39:15.731499 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:15.731445 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8bdfc4f7-68mr4" podStartSLOduration=1.731425764 podStartE2EDuration="1.731425764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:39:15.729042523 +0000 UTC m=+168.344433555" watchObservedRunningTime="2026-09-05 02:39:15.731425764 +0000 UTC m=+168.346816763" Sep 05 02:39:25.156559 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:25.156521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:25.156978 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:25.156575 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:25.161268 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:25.161244 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:25.756804 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:25.756774 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:39:25.850577 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:25.850541 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb79f8cdd-rhg5t"] Sep 05 02:39:25.997773 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:25.997738 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:26.099330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:26.099302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:26.166391 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:26.166353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:50.870614 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:50.870555 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fb79f8cdd-rhg5t" podUID="d403b68c-58f5-4dc2-bc50-86a0345cb5ed" containerName="console" containerID="cri-o://2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476" gracePeriod=15 Sep 05 02:39:51.109557 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.109529 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:39:51.177915 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.177854 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8dks\" (UniqueName: \"kubernetes.io/projected/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-kube-api-access-f8dks\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.177915 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.177887 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-trusted-ca-bundle\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.177915 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.177914 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-service-ca\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.178131 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.177960 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-oauth-config\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.178131 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.177989 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-serving-cert\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.178131 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.178044 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-oauth-serving-cert\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.178131 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.178069 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-config\") pod \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\" (UID: \"d403b68c-58f5-4dc2-bc50-86a0345cb5ed\") " Sep 05 02:39:51.178377 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.178341 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:39:51.178377 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.178349 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:39:51.178493 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.178412 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:39:51.178553 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.178504 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-config" (OuterVolumeSpecName: "console-config") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:39:51.180206 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.180184 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:51.180595 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.180576 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:39:51.180662 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.180589 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-kube-api-access-f8dks" (OuterVolumeSpecName: "kube-api-access-f8dks") pod "d403b68c-58f5-4dc2-bc50-86a0345cb5ed" (UID: "d403b68c-58f5-4dc2-bc50-86a0345cb5ed"). InnerVolumeSpecName "kube-api-access-f8dks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:39:51.279419 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279396 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8dks\" (UniqueName: \"kubernetes.io/projected/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-kube-api-access-f8dks\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.279419 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279417 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-trusted-ca-bundle\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.279551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279427 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-service-ca\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.279551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279436 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-oauth-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.279551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279444 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.279551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279452 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-oauth-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.279551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.279461 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d403b68c-58f5-4dc2-bc50-86a0345cb5ed-console-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:39:51.855903 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.855862 2577 generic.go:356] "Generic (PLEG): container finished" podID="d403b68c-58f5-4dc2-bc50-86a0345cb5ed" containerID="2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476" exitCode=0 Sep 05 02:39:51.855903 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.855905 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb79f8cdd-rhg5t" event={"ID":"d403b68c-58f5-4dc2-bc50-86a0345cb5ed","Type":"ContainerDied","Data":"2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476"} Sep 05 02:39:51.856162 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.855914 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fb79f8cdd-rhg5t" Sep 05 02:39:51.856162 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.855988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fb79f8cdd-rhg5t" event={"ID":"d403b68c-58f5-4dc2-bc50-86a0345cb5ed","Type":"ContainerDied","Data":"e21bc1da291c9465e835f44222e0a8c3ed19abf028c04ebdb96610681c65fdf0"} Sep 05 02:39:51.856162 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.856015 2577 scope.go:117] "RemoveContainer" containerID="2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476" Sep 05 02:39:51.865242 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.865224 2577 scope.go:117] "RemoveContainer" containerID="2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476" Sep 05 02:39:51.865546 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:39:51.865527 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476\": container with ID starting with 2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476 not found: ID does not exist" containerID="2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476" Sep 05 02:39:51.865590 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.865557 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476"} err="failed to get container status \"2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476\": rpc error: code = NotFound desc = could not find container \"2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476\": container with ID starting with 2b52bfd6c1ab78aeba4200e7d3ba7b52a58fd2c5c52c2e9cbe3b40bf2e5d8476 not found: ID does not exist" Sep 05 02:39:51.894960 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.894938 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fb79f8cdd-rhg5t"] Sep 05 02:39:51.898388 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.898367 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fb79f8cdd-rhg5t"] Sep 05 02:39:51.926797 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:51.926774 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:52.011824 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:52.011805 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:39:53.868264 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:39:53.868232 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d403b68c-58f5-4dc2-bc50-86a0345cb5ed" path="/var/lib/kubelet/pods/d403b68c-58f5-4dc2-bc50-86a0345cb5ed/volumes" Sep 05 02:40:22.239621 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:22.239587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:40:23.021723 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:23.021691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:40:34.174233 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:34.174202 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:40:34.274185 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:34.274145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:40:50.207488 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:50.207397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:40:51.365607 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:51.365575 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:40:51.483407 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:40:51.483371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:00.844529 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.844490 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d6f5898b-nw8s8"] Sep 05 02:41:00.845033 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.844958 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d403b68c-58f5-4dc2-bc50-86a0345cb5ed" containerName="console" Sep 05 02:41:00.845033 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.844977 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d403b68c-58f5-4dc2-bc50-86a0345cb5ed" containerName="console" Sep 05 02:41:00.845144 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.845061 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d403b68c-58f5-4dc2-bc50-86a0345cb5ed" containerName="console" Sep 05 02:41:00.847246 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.847222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.858567 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.858546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d6f5898b-nw8s8"] Sep 05 02:41:00.908634 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-service-ca\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.908776 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-serving-cert\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.908776 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-console-config\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.908776 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzm6\" (UniqueName: \"kubernetes.io/projected/e211253b-41f6-4a56-9634-662925885f8f-kube-api-access-pqzm6\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.908889 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-oauth-config\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.908889 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-oauth-serving-cert\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.908965 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.908895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-trusted-ca-bundle\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:00.925235 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.925210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:00.984061 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:00.984033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:01.010251 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-oauth-config\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.010324 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-oauth-serving-cert\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.010324 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-trusted-ca-bundle\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.010324 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-service-ca\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.010468 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-serving-cert\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.010521 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-console-config\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.010521 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.010497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzm6\" (UniqueName: \"kubernetes.io/projected/e211253b-41f6-4a56-9634-662925885f8f-kube-api-access-pqzm6\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.011133 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.011048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-oauth-serving-cert\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.011244 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.011203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-trusted-ca-bundle\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.011244 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.011215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-console-config\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.011376 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.011354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-service-ca\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.012963 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.012943 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-oauth-config\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.013042 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.013005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-serving-cert\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.018967 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.018948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzm6\" (UniqueName: \"kubernetes.io/projected/e211253b-41f6-4a56-9634-662925885f8f-kube-api-access-pqzm6\") pod \"console-77d6f5898b-nw8s8\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.155779 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.155723 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:01.433257 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:01.433235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d6f5898b-nw8s8"] Sep 05 02:41:01.437924 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:41:01.437899 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode211253b_41f6_4a56_9634_662925885f8f.slice/crio-1e4c923139d59ca8ddc13f5fbff521807192f4613c8230e87d3acbc18cbd0c25 WatchSource:0}: Error finding container 1e4c923139d59ca8ddc13f5fbff521807192f4613c8230e87d3acbc18cbd0c25: Status 404 returned error can't find the container with id 1e4c923139d59ca8ddc13f5fbff521807192f4613c8230e87d3acbc18cbd0c25 Sep 05 02:41:02.123278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:02.123246 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d6f5898b-nw8s8" event={"ID":"e211253b-41f6-4a56-9634-662925885f8f","Type":"ContainerStarted","Data":"af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed"} Sep 05 02:41:02.123680 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:02.123291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d6f5898b-nw8s8" event={"ID":"e211253b-41f6-4a56-9634-662925885f8f","Type":"ContainerStarted","Data":"1e4c923139d59ca8ddc13f5fbff521807192f4613c8230e87d3acbc18cbd0c25"} Sep 05 02:41:02.147904 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:02.147849 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77d6f5898b-nw8s8" podStartSLOduration=2.147830571 podStartE2EDuration="2.147830571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:41:02.146608162 +0000 UTC m=+274.761999158" watchObservedRunningTime="2026-09-05 02:41:02.147830571 +0000 UTC m=+274.763221571" Sep 05 02:41:11.155898 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:11.155860 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:11.156287 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:11.155921 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:11.160707 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:11.160687 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:12.170959 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:12.170932 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:41:12.234063 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:12.234034 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8bdfc4f7-68mr4"] Sep 05 02:41:12.399540 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:12.399506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:12.494784 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:12.494713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:27.768952 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:27.768923 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 05 02:41:37.167898 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.167851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:37.254058 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.254008 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d8bdfc4f7-68mr4" podUID="c781411a-6675-4eac-9dd7-b7d9eb71fb6f" containerName="console" containerID="cri-o://33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2" gracePeriod=15 Sep 05 02:41:37.495452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.495431 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:41:37.596925 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.596900 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mngc\" (UniqueName: \"kubernetes.io/projected/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-kube-api-access-9mngc\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597047 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.596938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-trusted-ca-bundle\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597047 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.596976 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-oauth-config\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597047 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.596998 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-config\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597047 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-oauth-serving-cert\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597047 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597048 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-service-ca\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597065 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-serving-cert\") pod \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\" (UID: \"c781411a-6675-4eac-9dd7-b7d9eb71fb6f\") " Sep 05 02:41:37.597405 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597359 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:41:37.597405 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597362 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-config" (OuterVolumeSpecName: "console-config") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:41:37.597635 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597602 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:41:37.597918 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.597818 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-service-ca" (OuterVolumeSpecName: "service-ca") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:41:37.599130 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.599107 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-kube-api-access-9mngc" (OuterVolumeSpecName: "kube-api-access-9mngc") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "kube-api-access-9mngc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:41:37.599242 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.599219 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:41:37.599242 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.599235 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c781411a-6675-4eac-9dd7-b7d9eb71fb6f" (UID: "c781411a-6675-4eac-9dd7-b7d9eb71fb6f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:41:37.697704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697656 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-oauth-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:37.697704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697677 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-service-ca\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:37.697704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697687 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:37.697704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697696 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mngc\" (UniqueName: \"kubernetes.io/projected/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-kube-api-access-9mngc\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:37.697704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697705 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-trusted-ca-bundle\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:37.697704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697713 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-oauth-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:37.697958 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:37.697721 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c781411a-6675-4eac-9dd7-b7d9eb71fb6f-console-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:38.015891 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.015832 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n"] Sep 05 02:41:38.016129 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.016117 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c781411a-6675-4eac-9dd7-b7d9eb71fb6f" containerName="console" Sep 05 02:41:38.016170 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.016130 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c781411a-6675-4eac-9dd7-b7d9eb71fb6f" containerName="console" Sep 05 02:41:38.016204 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.016186 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c781411a-6675-4eac-9dd7-b7d9eb71fb6f" containerName="console" Sep 05 02:41:38.019441 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.019426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.021621 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.021603 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 05 02:41:38.021621 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.021613 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 05 02:41:38.022079 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.022064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grc59\"" Sep 05 02:41:38.028465 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.028444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n"] Sep 05 02:41:38.099653 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.099625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.099754 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.099681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdlf\" (UniqueName: \"kubernetes.io/projected/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-kube-api-access-7zdlf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.099754 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.099708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.199975 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.199945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.200292 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.199981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdlf\" (UniqueName: \"kubernetes.io/projected/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-kube-api-access-7zdlf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.200292 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.200018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.200404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.200352 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.200404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.200375 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.209420 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.209396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdlf\" (UniqueName: \"kubernetes.io/projected/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-kube-api-access-7zdlf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.266083 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.266035 2577 generic.go:356] "Generic (PLEG): container finished" podID="c781411a-6675-4eac-9dd7-b7d9eb71fb6f" containerID="33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2" exitCode=0 Sep 05 02:41:38.266167 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.266086 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8bdfc4f7-68mr4" Sep 05 02:41:38.266214 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.266088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bdfc4f7-68mr4" event={"ID":"c781411a-6675-4eac-9dd7-b7d9eb71fb6f","Type":"ContainerDied","Data":"33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2"} Sep 05 02:41:38.266251 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.266215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8bdfc4f7-68mr4" event={"ID":"c781411a-6675-4eac-9dd7-b7d9eb71fb6f","Type":"ContainerDied","Data":"5f3a232439ddfd066d3b15267bdfecd78adf75919b438e7545b23b27310f0d8d"} Sep 05 02:41:38.266251 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.266247 2577 scope.go:117] "RemoveContainer" containerID="33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2" Sep 05 02:41:38.274547 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.274530 2577 scope.go:117] "RemoveContainer" containerID="33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2" Sep 05 02:41:38.274857 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:41:38.274838 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2\": container with ID starting with 33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2 not found: ID does not exist" containerID="33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2" Sep 05 02:41:38.274912 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.274865 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2"} err="failed to get container status \"33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2\": rpc error: code = NotFound desc = could not find container \"33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2\": container with ID starting with 33c404576e38bfa190161b34a74531b5f37b7408efb0a0cde0a71588862ff9c2 not found: ID does not exist" Sep 05 02:41:38.281330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.281312 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8bdfc4f7-68mr4"] Sep 05 02:41:38.286001 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.285969 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8bdfc4f7-68mr4"] Sep 05 02:41:38.328146 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.328125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:38.598336 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.598311 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n"] Sep 05 02:41:38.600882 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.600856 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:38.601095 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:41:38.601076 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edba8dc_8dc6_4c2f_96b5_a0ab9f0560dc.slice/crio-2703421779d141c0188de8d4aaa79e2060f38180dd196ee611c59c9c8facfb10 WatchSource:0}: Error finding container 2703421779d141c0188de8d4aaa79e2060f38180dd196ee611c59c9c8facfb10: Status 404 returned error can't find the container with id 2703421779d141c0188de8d4aaa79e2060f38180dd196ee611c59c9c8facfb10 Sep 05 02:41:38.602995 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:38.602980 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:41:39.271428 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:39.271385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" event={"ID":"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc","Type":"ContainerStarted","Data":"2703421779d141c0188de8d4aaa79e2060f38180dd196ee611c59c9c8facfb10"} Sep 05 02:41:39.870330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:39.870296 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c781411a-6675-4eac-9dd7-b7d9eb71fb6f" path="/var/lib/kubelet/pods/c781411a-6675-4eac-9dd7-b7d9eb71fb6f/volumes" Sep 05 02:41:45.301435 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:45.301404 2577 generic.go:356] "Generic (PLEG): container finished" podID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerID="7ef655cd9657aba644902fa07a1b612bc44bda20813231a6badf53b9136c8d37" exitCode=0 Sep 05 02:41:45.301905 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:45.301495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" event={"ID":"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc","Type":"ContainerDied","Data":"7ef655cd9657aba644902fa07a1b612bc44bda20813231a6badf53b9136c8d37"} Sep 05 02:41:48.317301 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:48.317265 2577 generic.go:356] "Generic (PLEG): container finished" podID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerID="241e1f395d4b220512cdf066e38a2fe10a16c125a313bf770a01df487b3ec078" exitCode=0 Sep 05 02:41:48.317703 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:48.317376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" event={"ID":"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc","Type":"ContainerDied","Data":"241e1f395d4b220512cdf066e38a2fe10a16c125a313bf770a01df487b3ec078"} Sep 05 02:41:55.352117 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:55.352083 2577 generic.go:356] "Generic (PLEG): container finished" podID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerID="d44cd235d9f419ffcabedf1fe785d49147708412978b3e4bf5d62cb946689f76" exitCode=0 Sep 05 02:41:55.352572 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:55.352162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" event={"ID":"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc","Type":"ContainerDied","Data":"d44cd235d9f419ffcabedf1fe785d49147708412978b3e4bf5d62cb946689f76"} Sep 05 02:41:56.478612 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.478588 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:56.558556 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.558519 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-util\") pod \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " Sep 05 02:41:56.558748 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.558584 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zdlf\" (UniqueName: \"kubernetes.io/projected/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-kube-api-access-7zdlf\") pod \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " Sep 05 02:41:56.560929 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.560898 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-kube-api-access-7zdlf" (OuterVolumeSpecName: "kube-api-access-7zdlf") pod "8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" (UID: "8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc"). InnerVolumeSpecName "kube-api-access-7zdlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:41:56.562846 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.562824 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-util" (OuterVolumeSpecName: "util") pod "8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" (UID: "8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:41:56.659809 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.659708 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-bundle\") pod \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\" (UID: \"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc\") " Sep 05 02:41:56.659957 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.659897 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zdlf\" (UniqueName: \"kubernetes.io/projected/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-kube-api-access-7zdlf\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:56.659957 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.659919 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-util\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:56.660322 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.660297 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-bundle" (OuterVolumeSpecName: "bundle") pod "8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" (UID: "8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:41:56.760939 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:56.760904 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc-bundle\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:41:57.040267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:57.040184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:57.361511 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:57.361487 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" Sep 05 02:41:57.361698 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:57.361511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dtn5n" event={"ID":"8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc","Type":"ContainerDied","Data":"2703421779d141c0188de8d4aaa79e2060f38180dd196ee611c59c9c8facfb10"} Sep 05 02:41:57.361698 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:57.361561 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2703421779d141c0188de8d4aaa79e2060f38180dd196ee611c59c9c8facfb10" Sep 05 02:41:59.034458 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:59.034421 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:41:59.839844 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:41:59.839804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:01.226172 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226133 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4"] Sep 05 02:42:01.226631 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226585 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="util" Sep 05 02:42:01.226631 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226603 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="util" Sep 05 02:42:01.226631 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226614 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="extract" Sep 05 02:42:01.226631 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226623 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="extract" Sep 05 02:42:01.226925 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226663 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="pull" Sep 05 02:42:01.226925 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226672 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="pull" Sep 05 02:42:01.226925 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.226758 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8edba8dc-8dc6-4c2f-96b5-a0ab9f0560dc" containerName="extract" Sep 05 02:42:01.276186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.276154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4"] Sep 05 02:42:01.276326 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.276256 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.278705 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.278681 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:42:01.278833 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.278680 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-26ntc\"" Sep 05 02:42:01.278833 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.278756 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 05 02:42:01.293532 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.293504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cabd020-dade-4c52-b837-0da99a879bff-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-7sfv4\" (UID: \"1cabd020-dade-4c52-b837-0da99a879bff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.293714 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.293535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26q5v\" (UniqueName: \"kubernetes.io/projected/1cabd020-dade-4c52-b837-0da99a879bff-kube-api-access-26q5v\") pod \"cert-manager-operator-controller-manager-56b4598547-7sfv4\" (UID: \"1cabd020-dade-4c52-b837-0da99a879bff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.394551 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.394523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cabd020-dade-4c52-b837-0da99a879bff-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-7sfv4\" (UID: \"1cabd020-dade-4c52-b837-0da99a879bff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.394742 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.394558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26q5v\" (UniqueName: \"kubernetes.io/projected/1cabd020-dade-4c52-b837-0da99a879bff-kube-api-access-26q5v\") pod \"cert-manager-operator-controller-manager-56b4598547-7sfv4\" (UID: \"1cabd020-dade-4c52-b837-0da99a879bff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.394917 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.394897 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cabd020-dade-4c52-b837-0da99a879bff-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-7sfv4\" (UID: \"1cabd020-dade-4c52-b837-0da99a879bff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.402285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.402264 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26q5v\" (UniqueName: \"kubernetes.io/projected/1cabd020-dade-4c52-b837-0da99a879bff-kube-api-access-26q5v\") pod \"cert-manager-operator-controller-manager-56b4598547-7sfv4\" (UID: \"1cabd020-dade-4c52-b837-0da99a879bff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.586781 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.586747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" Sep 05 02:42:01.884202 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:01.884113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4"] Sep 05 02:42:01.892132 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:42:01.892103 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cabd020_dade_4c52_b837_0da99a879bff.slice/crio-d67047353d4ceba321911744c54332abcaff6029a5198aece50776be399c8ce0 WatchSource:0}: Error finding container d67047353d4ceba321911744c54332abcaff6029a5198aece50776be399c8ce0: Status 404 returned error can't find the container with id d67047353d4ceba321911744c54332abcaff6029a5198aece50776be399c8ce0 Sep 05 02:42:02.384218 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:02.384175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" event={"ID":"1cabd020-dade-4c52-b837-0da99a879bff","Type":"ContainerStarted","Data":"d67047353d4ceba321911744c54332abcaff6029a5198aece50776be399c8ce0"} Sep 05 02:42:02.650398 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:02.650319 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:02.744425 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:02.744389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:06.403665 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:06.403567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" event={"ID":"1cabd020-dade-4c52-b837-0da99a879bff","Type":"ContainerStarted","Data":"6fa5bbfb6b127fddbf14b12e7144cfb8e9496885bd9e8ff3822d2e0d6160ff33"} Sep 05 02:42:06.424185 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:06.424128 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7sfv4" podStartSLOduration=1.209919724 podStartE2EDuration="5.424109214s" totalImagesPullingTime="4.21418949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:42:06.423156057 +0000 UTC m=+339.038547053" watchObservedRunningTime="2026-09-05 02:42:06.424109214 +0000 UTC m=+339.039500213" Sep 05 02:42:06.798272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:06.798182 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:06.886814 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:06.886778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:07.641988 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.641953 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:07.734434 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.734399 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j4fcn"] Sep 05 02:42:07.736859 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.736836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:07.737197 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.737153 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:07.739149 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.739127 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 05 02:42:07.739272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.739154 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 05 02:42:07.739272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.739155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jzgsw\"" Sep 05 02:42:07.748302 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.748282 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j4fcn"] Sep 05 02:42:07.752906 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.752886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j4fcn\" (UID: \"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:07.752994 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.752913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcmx\" (UniqueName: \"kubernetes.io/projected/ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab-kube-api-access-jzcmx\") pod \"cert-manager-webhook-6486ffd997-j4fcn\" (UID: \"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:07.854122 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.854089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j4fcn\" (UID: \"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:07.854122 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.854123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcmx\" (UniqueName: \"kubernetes.io/projected/ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab-kube-api-access-jzcmx\") pod \"cert-manager-webhook-6486ffd997-j4fcn\" (UID: \"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:07.862794 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.862758 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j4fcn\" (UID: \"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:07.862918 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:07.862899 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcmx\" (UniqueName: \"kubernetes.io/projected/ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab-kube-api-access-jzcmx\") pod \"cert-manager-webhook-6486ffd997-j4fcn\" (UID: \"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:08.046048 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:08.045962 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:08.316970 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:08.316941 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j4fcn"] Sep 05 02:42:08.320104 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:42:08.320074 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae8a1773_0778_4e6d_b6dc_77c0f4cb2eab.slice/crio-e24a5e5d21635654cbf8568e5b018ad081cd801342cf8228eb87bd5318d3b800 WatchSource:0}: Error finding container e24a5e5d21635654cbf8568e5b018ad081cd801342cf8228eb87bd5318d3b800: Status 404 returned error can't find the container with id e24a5e5d21635654cbf8568e5b018ad081cd801342cf8228eb87bd5318d3b800 Sep 05 02:42:08.412299 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:08.412263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" event={"ID":"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab","Type":"ContainerStarted","Data":"e24a5e5d21635654cbf8568e5b018ad081cd801342cf8228eb87bd5318d3b800"} Sep 05 02:42:09.177953 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:09.177922 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:09.563156 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:09.563118 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:11.427068 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:11.427031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" event={"ID":"ae8a1773-0778-4e6d-b6dc-77c0f4cb2eab","Type":"ContainerStarted","Data":"e23c21b18d1c72cf69f9cf43e45d02928e22d63eb96b7611fe1bafa1757f5dda"} Sep 05 02:42:11.427485 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:11.427078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:11.446226 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:11.446171 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" podStartSLOduration=1.949769545 podStartE2EDuration="4.446155649s" totalImagesPullingTime="2.496386104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:42:11.44494648 +0000 UTC m=+344.060337476" watchObservedRunningTime="2026-09-05 02:42:11.446155649 +0000 UTC m=+344.061546645" Sep 05 02:42:11.995309 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:11.995275 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r"] Sep 05 02:42:11.997867 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:11.997847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:11.999688 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:11.999667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d52sz\"" Sep 05 02:42:12.007976 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.007955 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r"] Sep 05 02:42:12.094158 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.094130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08f5b8ca-ae23-4642-b48f-bf8d431506e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cqp2r\" (UID: \"08f5b8ca-ae23-4642-b48f-bf8d431506e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.094337 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.094179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fswsn\" (UniqueName: \"kubernetes.io/projected/08f5b8ca-ae23-4642-b48f-bf8d431506e3-kube-api-access-fswsn\") pod \"cert-manager-cainjector-559cdd8c87-cqp2r\" (UID: \"08f5b8ca-ae23-4642-b48f-bf8d431506e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.194823 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.194781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fswsn\" (UniqueName: \"kubernetes.io/projected/08f5b8ca-ae23-4642-b48f-bf8d431506e3-kube-api-access-fswsn\") pod \"cert-manager-cainjector-559cdd8c87-cqp2r\" (UID: \"08f5b8ca-ae23-4642-b48f-bf8d431506e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.194984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.194852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08f5b8ca-ae23-4642-b48f-bf8d431506e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cqp2r\" (UID: \"08f5b8ca-ae23-4642-b48f-bf8d431506e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.205915 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.205886 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08f5b8ca-ae23-4642-b48f-bf8d431506e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cqp2r\" (UID: \"08f5b8ca-ae23-4642-b48f-bf8d431506e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.206047 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.205895 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fswsn\" (UniqueName: \"kubernetes.io/projected/08f5b8ca-ae23-4642-b48f-bf8d431506e3-kube-api-access-fswsn\") pod \"cert-manager-cainjector-559cdd8c87-cqp2r\" (UID: \"08f5b8ca-ae23-4642-b48f-bf8d431506e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.307492 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.307474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" Sep 05 02:42:12.576142 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:12.576117 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r"] Sep 05 02:42:12.578580 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:42:12.578554 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08f5b8ca_ae23_4642_b48f_bf8d431506e3.slice/crio-8cdbfe2afef36e73c9d1f5372b2638b6c4262ef6d7ab4eb2465e7ed0415ef4aa WatchSource:0}: Error finding container 8cdbfe2afef36e73c9d1f5372b2638b6c4262ef6d7ab4eb2465e7ed0415ef4aa: Status 404 returned error can't find the container with id 8cdbfe2afef36e73c9d1f5372b2638b6c4262ef6d7ab4eb2465e7ed0415ef4aa Sep 05 02:42:13.440918 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:13.440878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" event={"ID":"08f5b8ca-ae23-4642-b48f-bf8d431506e3","Type":"ContainerStarted","Data":"d11e1709b162f1ca3c888a353d74c607d3bcf9af97c05c430a2724c88dd23925"} Sep 05 02:42:13.440918 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:13.440924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" event={"ID":"08f5b8ca-ae23-4642-b48f-bf8d431506e3","Type":"ContainerStarted","Data":"8cdbfe2afef36e73c9d1f5372b2638b6c4262ef6d7ab4eb2465e7ed0415ef4aa"} Sep 05 02:42:13.456050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:13.456006 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cqp2r" podStartSLOduration=2.455992084 podStartE2EDuration="2.455992084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:42:13.454413051 +0000 UTC m=+346.069804050" watchObservedRunningTime="2026-09-05 02:42:13.455992084 +0000 UTC m=+346.071383080" Sep 05 02:42:17.376690 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:17.376636 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:17.437470 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:17.437444 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j4fcn" Sep 05 02:42:21.949492 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:21.949403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:22.045352 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.045317 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:22.870326 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.870289 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6"] Sep 05 02:42:22.872786 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.872767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:22.874851 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.874828 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 05 02:42:22.874969 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.874849 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 05 02:42:22.875227 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.875214 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-grc59\"" Sep 05 02:42:22.880871 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.880847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6"] Sep 05 02:42:22.993576 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.993541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:22.993992 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.993601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh6v\" (UniqueName: \"kubernetes.io/projected/7d958b91-75dd-4690-afc1-fa3a7077dcf1-kube-api-access-fmh6v\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:22.993992 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:22.993623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.094808 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.094774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh6v\" (UniqueName: \"kubernetes.io/projected/7d958b91-75dd-4690-afc1-fa3a7077dcf1-kube-api-access-fmh6v\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.094969 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.094818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.094969 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.094907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.095257 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.095234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.095330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.095263 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.103050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.103027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh6v\" (UniqueName: \"kubernetes.io/projected/7d958b91-75dd-4690-afc1-fa3a7077dcf1-kube-api-access-fmh6v\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.183027 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.182948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:23.452173 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.452147 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6"] Sep 05 02:42:23.454011 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:42:23.453984 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d958b91_75dd_4690_afc1_fa3a7077dcf1.slice/crio-82cdfb4c3bb8532f4f0cb2e94ed6cabcb7efe2e72b94fbd6ed36b569bdd3f791 WatchSource:0}: Error finding container 82cdfb4c3bb8532f4f0cb2e94ed6cabcb7efe2e72b94fbd6ed36b569bdd3f791: Status 404 returned error can't find the container with id 82cdfb4c3bb8532f4f0cb2e94ed6cabcb7efe2e72b94fbd6ed36b569bdd3f791 Sep 05 02:42:23.483314 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:23.483289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" event={"ID":"7d958b91-75dd-4690-afc1-fa3a7077dcf1","Type":"ContainerStarted","Data":"82cdfb4c3bb8532f4f0cb2e94ed6cabcb7efe2e72b94fbd6ed36b569bdd3f791"} Sep 05 02:42:24.488947 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:24.488865 2577 generic.go:356] "Generic (PLEG): container finished" podID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerID="a705c979ee230d5e359a00912811ba619572168c6882a329e109cb9653a05450" exitCode=0 Sep 05 02:42:24.489312 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:24.488947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" event={"ID":"7d958b91-75dd-4690-afc1-fa3a7077dcf1","Type":"ContainerDied","Data":"a705c979ee230d5e359a00912811ba619572168c6882a329e109cb9653a05450"} Sep 05 02:42:27.508216 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:27.508119 2577 generic.go:356] "Generic (PLEG): container finished" podID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerID="bb7bd0bda566dd73246c554a42c1e48813268b8abbbf6aea2a0d949bfc505223" exitCode=0 Sep 05 02:42:27.508586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:27.508205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" event={"ID":"7d958b91-75dd-4690-afc1-fa3a7077dcf1","Type":"ContainerDied","Data":"bb7bd0bda566dd73246c554a42c1e48813268b8abbbf6aea2a0d949bfc505223"} Sep 05 02:42:28.514661 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:28.514612 2577 generic.go:356] "Generic (PLEG): container finished" podID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerID="cb43db6f06be4310b73cdb9a89be9a86d328b29dae6d096e160f95fe3e045370" exitCode=0 Sep 05 02:42:28.515013 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:28.514693 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" event={"ID":"7d958b91-75dd-4690-afc1-fa3a7077dcf1","Type":"ContainerDied","Data":"cb43db6f06be4310b73cdb9a89be9a86d328b29dae6d096e160f95fe3e045370"} Sep 05 02:42:29.669450 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.669425 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:29.750903 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.750870 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-bundle\") pod \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " Sep 05 02:42:29.750903 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.750908 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-util\") pod \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " Sep 05 02:42:29.751111 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.750971 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmh6v\" (UniqueName: \"kubernetes.io/projected/7d958b91-75dd-4690-afc1-fa3a7077dcf1-kube-api-access-fmh6v\") pod \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\" (UID: \"7d958b91-75dd-4690-afc1-fa3a7077dcf1\") " Sep 05 02:42:29.751357 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.751325 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-bundle" (OuterVolumeSpecName: "bundle") pod "7d958b91-75dd-4690-afc1-fa3a7077dcf1" (UID: "7d958b91-75dd-4690-afc1-fa3a7077dcf1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:42:29.753282 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.753257 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d958b91-75dd-4690-afc1-fa3a7077dcf1-kube-api-access-fmh6v" (OuterVolumeSpecName: "kube-api-access-fmh6v") pod "7d958b91-75dd-4690-afc1-fa3a7077dcf1" (UID: "7d958b91-75dd-4690-afc1-fa3a7077dcf1"). InnerVolumeSpecName "kube-api-access-fmh6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:42:29.757312 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.757280 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-util" (OuterVolumeSpecName: "util") pod "7d958b91-75dd-4690-afc1-fa3a7077dcf1" (UID: "7d958b91-75dd-4690-afc1-fa3a7077dcf1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:42:29.852157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.852133 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-bundle\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:42:29.852157 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.852156 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d958b91-75dd-4690-afc1-fa3a7077dcf1-util\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:42:29.852380 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:29.852166 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmh6v\" (UniqueName: \"kubernetes.io/projected/7d958b91-75dd-4690-afc1-fa3a7077dcf1-kube-api-access-fmh6v\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:42:30.526096 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:30.526062 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" Sep 05 02:42:30.526277 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:30.526095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78es4bb6" event={"ID":"7d958b91-75dd-4690-afc1-fa3a7077dcf1","Type":"ContainerDied","Data":"82cdfb4c3bb8532f4f0cb2e94ed6cabcb7efe2e72b94fbd6ed36b569bdd3f791"} Sep 05 02:42:30.526277 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:30.526147 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82cdfb4c3bb8532f4f0cb2e94ed6cabcb7efe2e72b94fbd6ed36b569bdd3f791" Sep 05 02:42:36.693793 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:36.693761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:36.756315 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:36.756286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:39.048306 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:39.048274 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:39.149222 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:39.149192 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:52.834215 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:52.834144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:53.246826 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:53.246747 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:53.361899 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:53.361860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:42:55.857912 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:42:55.857870 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:16.174169 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.174131 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:16.275011 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.274972 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:16.315396 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315363 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67dbfb6bd9-wj8mz"] Sep 05 02:43:16.315873 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315858 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="pull" Sep 05 02:43:16.315923 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315878 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="pull" Sep 05 02:43:16.315923 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315890 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="extract" Sep 05 02:43:16.315923 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315897 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="extract" Sep 05 02:43:16.315923 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315921 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="util" Sep 05 02:43:16.316050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.315930 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="util" Sep 05 02:43:16.316050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.316026 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d958b91-75dd-4690-afc1-fa3a7077dcf1" containerName="extract" Sep 05 02:43:16.322672 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.322633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.333500 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.333480 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67dbfb6bd9-wj8mz"] Sep 05 02:43:16.390325 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.390305 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:16.429128 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-serving-cert\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.429128 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-config\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.429128 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9b5\" (UniqueName: \"kubernetes.io/projected/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-kube-api-access-5l9b5\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.429267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-oauth-config\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.429267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-trusted-ca-bundle\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.429267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-oauth-serving-cert\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.429360 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.429268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-service-ca\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.504550 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.504527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:16.529559 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-oauth-config\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.529667 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-trusted-ca-bundle\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.529667 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-oauth-serving-cert\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.529667 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-service-ca\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.529816 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-serving-cert\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.529926 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-config\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.529926 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.529850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9b5\" (UniqueName: \"kubernetes.io/projected/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-kube-api-access-5l9b5\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.530384 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.530356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-service-ca\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.530483 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.530386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-oauth-serving-cert\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.530483 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.530454 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-config\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.530586 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.530493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-trusted-ca-bundle\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.532159 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.532131 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-oauth-config\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.532267 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.532247 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-console-serving-cert\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.537411 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.537394 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9b5\" (UniqueName: \"kubernetes.io/projected/0ec4f23d-265a-4b59-8fd1-b9786b22f6fe-kube-api-access-5l9b5\") pod \"console-67dbfb6bd9-wj8mz\" (UID: \"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe\") " pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.632039 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.632015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:16.903252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:16.903226 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67dbfb6bd9-wj8mz"] Sep 05 02:43:16.906006 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:43:16.905981 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec4f23d_265a_4b59_8fd1_b9786b22f6fe.slice/crio-43420add23c9ad7045bf5c94f886c4cff9cba907fa4d1053f83f32329c0b8187 WatchSource:0}: Error finding container 43420add23c9ad7045bf5c94f886c4cff9cba907fa4d1053f83f32329c0b8187: Status 404 returned error can't find the container with id 43420add23c9ad7045bf5c94f886c4cff9cba907fa4d1053f83f32329c0b8187 Sep 05 02:43:17.151024 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:17.150987 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:17.263994 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:17.263912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:17.735421 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:17.735389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67dbfb6bd9-wj8mz" event={"ID":"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe","Type":"ContainerStarted","Data":"f6fc2f4a2514318edcf94ad37b92fc8199d3f771b5e97c9015428d3043fc5ca0"} Sep 05 02:43:17.735596 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:17.735434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67dbfb6bd9-wj8mz" event={"ID":"0ec4f23d-265a-4b59-8fd1-b9786b22f6fe","Type":"ContainerStarted","Data":"43420add23c9ad7045bf5c94f886c4cff9cba907fa4d1053f83f32329c0b8187"} Sep 05 02:43:17.754011 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:17.753967 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67dbfb6bd9-wj8mz" podStartSLOduration=1.753947927 podStartE2EDuration="1.753947927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:43:17.752124438 +0000 UTC m=+410.367515434" watchObservedRunningTime="2026-09-05 02:43:17.753947927 +0000 UTC m=+410.369338926" Sep 05 02:43:19.339593 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.339561 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn"] Sep 05 02:43:19.342666 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.342631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.344808 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.344790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 05 02:43:19.345608 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.345585 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 05 02:43:19.345735 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.345607 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 05 02:43:19.345735 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.345609 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 05 02:43:19.345735 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.345611 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-wcrdx\"" Sep 05 02:43:19.363882 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.363863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn"] Sep 05 02:43:19.379404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.379381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:19.456745 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.456719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/2fa577bb-0e8b-416f-af8c-e248864b8cb8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.456859 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.456771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx2gx\" (UniqueName: \"kubernetes.io/projected/2fa577bb-0e8b-416f-af8c-e248864b8cb8-kube-api-access-sx2gx\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.456859 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.456798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fa577bb-0e8b-416f-af8c-e248864b8cb8-cert\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.481823 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.481781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:19.557703 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.557674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx2gx\" (UniqueName: \"kubernetes.io/projected/2fa577bb-0e8b-416f-af8c-e248864b8cb8-kube-api-access-sx2gx\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.557827 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.557720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fa577bb-0e8b-416f-af8c-e248864b8cb8-cert\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.557827 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.557772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/2fa577bb-0e8b-416f-af8c-e248864b8cb8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.558404 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.558381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/2fa577bb-0e8b-416f-af8c-e248864b8cb8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.560218 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.560201 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fa577bb-0e8b-416f-af8c-e248864b8cb8-cert\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.565247 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.565223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx2gx\" (UniqueName: \"kubernetes.io/projected/2fa577bb-0e8b-416f-af8c-e248864b8cb8-kube-api-access-sx2gx\") pod \"kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn\" (UID: \"2fa577bb-0e8b-416f-af8c-e248864b8cb8\") " pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.652006 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.651951 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:19.923831 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:19.923757 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn"] Sep 05 02:43:19.927022 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:43:19.926985 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fa577bb_0e8b_416f_af8c_e248864b8cb8.slice/crio-3c78e853c2e1bde20a3435eda316dd6ce8ab72c9bda74e6084c8ac1ef536dff2 WatchSource:0}: Error finding container 3c78e853c2e1bde20a3435eda316dd6ce8ab72c9bda74e6084c8ac1ef536dff2: Status 404 returned error can't find the container with id 3c78e853c2e1bde20a3435eda316dd6ce8ab72c9bda74e6084c8ac1ef536dff2 Sep 05 02:43:20.750177 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:20.750144 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" event={"ID":"2fa577bb-0e8b-416f-af8c-e248864b8cb8","Type":"ContainerStarted","Data":"3c78e853c2e1bde20a3435eda316dd6ce8ab72c9bda74e6084c8ac1ef536dff2"} Sep 05 02:43:22.762161 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:22.762129 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" event={"ID":"2fa577bb-0e8b-416f-af8c-e248864b8cb8","Type":"ContainerStarted","Data":"345cb564d8a0f5f9798d4674ae6d759bbcdf05b7a544dc088b66b1bb5497b81b"} Sep 05 02:43:22.762597 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:22.762253 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:43:22.780099 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:22.780055 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podStartSLOduration=1.1769673649999999 podStartE2EDuration="3.780041439s" totalImagesPullingTime="2.603074074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:43:22.778709236 +0000 UTC m=+415.394100233" watchObservedRunningTime="2026-09-05 02:43:22.780041439 +0000 UTC m=+415.395432434" Sep 05 02:43:24.326704 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:24.326665 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:24.384082 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:24.384041 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:26.632320 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:26.632290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:26.632787 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:26.632383 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:26.636810 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:26.636792 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:26.785416 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:26.785388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67dbfb6bd9-wj8mz" Sep 05 02:43:26.831857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:26.831826 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d6f5898b-nw8s8"] Sep 05 02:43:26.942456 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:26.942378 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:27.043591 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:27.043558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:27.127861 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:27.127818 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:43:38.769101 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:38.769053 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podUID="2fa577bb-0e8b-416f-af8c-e248864b8cb8" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 05 02:43:51.852809 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:51.852696 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77d6f5898b-nw8s8" podUID="e211253b-41f6-4a56-9634-662925885f8f" containerName="console" containerID="cri-o://af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed" gracePeriod=15 Sep 05 02:43:52.090313 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.090281 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:43:52.111850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.111793 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-trusted-ca-bundle\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.111850 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.111835 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-oauth-config\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.112026 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.111878 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-service-ca\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.112026 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.111916 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-console-config\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.112026 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.111932 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-oauth-serving-cert\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.112026 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.111993 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqzm6\" (UniqueName: \"kubernetes.io/projected/e211253b-41f6-4a56-9634-662925885f8f-kube-api-access-pqzm6\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.112234 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.112037 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-serving-cert\") pod \"e211253b-41f6-4a56-9634-662925885f8f\" (UID: \"e211253b-41f6-4a56-9634-662925885f8f\") " Sep 05 02:43:52.112234 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.112218 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:43:52.112341 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.112303 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-trusted-ca-bundle\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.112422 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.112311 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-console-config" (OuterVolumeSpecName: "console-config") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:43:52.112635 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.112483 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:43:52.112778 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.112627 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:43:52.114664 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.114606 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:43:52.114664 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.114605 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e211253b-41f6-4a56-9634-662925885f8f-kube-api-access-pqzm6" (OuterVolumeSpecName: "kube-api-access-pqzm6") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "kube-api-access-pqzm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:43:52.114793 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.114693 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e211253b-41f6-4a56-9634-662925885f8f" (UID: "e211253b-41f6-4a56-9634-662925885f8f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:43:52.213176 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.213147 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-oauth-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.213176 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.213174 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-service-ca\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.213321 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.213187 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-console-config\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.213321 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.213200 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e211253b-41f6-4a56-9634-662925885f8f-oauth-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.213321 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.213212 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqzm6\" (UniqueName: \"kubernetes.io/projected/e211253b-41f6-4a56-9634-662925885f8f-kube-api-access-pqzm6\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.213321 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.213225 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e211253b-41f6-4a56-9634-662925885f8f-console-serving-cert\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:43:52.909356 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.909320 2577 generic.go:356] "Generic (PLEG): container finished" podID="e211253b-41f6-4a56-9634-662925885f8f" containerID="af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed" exitCode=0 Sep 05 02:43:52.909807 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.909363 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d6f5898b-nw8s8" Sep 05 02:43:52.909807 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.909406 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d6f5898b-nw8s8" event={"ID":"e211253b-41f6-4a56-9634-662925885f8f","Type":"ContainerDied","Data":"af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed"} Sep 05 02:43:52.909807 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.909462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d6f5898b-nw8s8" event={"ID":"e211253b-41f6-4a56-9634-662925885f8f","Type":"ContainerDied","Data":"1e4c923139d59ca8ddc13f5fbff521807192f4613c8230e87d3acbc18cbd0c25"} Sep 05 02:43:52.909807 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.909485 2577 scope.go:117] "RemoveContainer" containerID="af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed" Sep 05 02:43:52.918705 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.918685 2577 scope.go:117] "RemoveContainer" containerID="af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed" Sep 05 02:43:52.918959 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:43:52.918941 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed\": container with ID starting with af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed not found: ID does not exist" containerID="af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed" Sep 05 02:43:52.919050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.918966 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed"} err="failed to get container status \"af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed\": rpc error: code = NotFound desc = could not find container \"af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed\": container with ID starting with af33d55f391ee0961ef031a6306aa21954dd2b30af0860feab8b7cfd22ba56ed not found: ID does not exist" Sep 05 02:43:52.930016 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.929997 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d6f5898b-nw8s8"] Sep 05 02:43:52.934019 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:52.933998 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d6f5898b-nw8s8"] Sep 05 02:43:53.769333 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:53.769290 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podUID="2fa577bb-0e8b-416f-af8c-e248864b8cb8" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 05 02:43:53.868835 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:43:53.868804 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e211253b-41f6-4a56-9634-662925885f8f" path="/var/lib/kubelet/pods/e211253b-41f6-4a56-9634-662925885f8f/volumes" Sep 05 02:44:08.768098 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:44:08.768057 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podUID="2fa577bb-0e8b-416f-af8c-e248864b8cb8" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 05 02:44:23.768310 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:44:23.768263 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podUID="2fa577bb-0e8b-416f-af8c-e248864b8cb8" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 05 02:44:33.863965 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:44:33.863927 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podUID="2fa577bb-0e8b-416f-af8c-e248864b8cb8" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 05 02:44:48.864368 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:44:48.864326 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" podUID="2fa577bb-0e8b-416f-af8c-e248864b8cb8" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 05 02:45:03.868851 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:45:03.868817 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7dfdc6d5d8-xwpwn" Sep 05 02:45:46.547732 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:45:46.547700 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:46:11.643217 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.643175 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:46:11.745360 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.745332 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:46:11.809395 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.809358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:46:11.815111 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.815080 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6"] Sep 05 02:46:11.815397 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.815386 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e211253b-41f6-4a56-9634-662925885f8f" containerName="console" Sep 05 02:46:11.815446 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.815399 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e211253b-41f6-4a56-9634-662925885f8f" containerName="console" Sep 05 02:46:11.815481 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.815463 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e211253b-41f6-4a56-9634-662925885f8f" containerName="console" Sep 05 02:46:11.818313 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.818296 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:46:11.820949 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.820923 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"kube-root-ca.crt\"" Sep 05 02:46:11.821050 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.820952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"default-dockercfg-8hdvc\"" Sep 05 02:46:11.821473 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.821458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"openshift-service-ca.crt\"" Sep 05 02:46:11.828367 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.828347 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6"] Sep 05 02:46:11.919496 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:11.919423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chk5n\" (UniqueName: \"kubernetes.io/projected/cda8ede2-4b54-45cd-9825-73beba13f449-kube-api-access-chk5n\") pod \"progression-enabled-node-0-0-j7nw6\" (UID: \"cda8ede2-4b54-45cd-9825-73beba13f449\") " pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:46:12.020134 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:12.020103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chk5n\" (UniqueName: \"kubernetes.io/projected/cda8ede2-4b54-45cd-9825-73beba13f449-kube-api-access-chk5n\") pod \"progression-enabled-node-0-0-j7nw6\" (UID: \"cda8ede2-4b54-45cd-9825-73beba13f449\") " pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:46:12.028337 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:12.028308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chk5n\" (UniqueName: \"kubernetes.io/projected/cda8ede2-4b54-45cd-9825-73beba13f449-kube-api-access-chk5n\") pod \"progression-enabled-node-0-0-j7nw6\" (UID: \"cda8ede2-4b54-45cd-9825-73beba13f449\") " pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:46:12.128495 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:12.128467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:46:12.404727 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:12.404700 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6"] Sep 05 02:46:12.407202 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:46:12.407166 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda8ede2_4b54_45cd_9825_73beba13f449.slice/crio-97317f199862f68dc19045b17bd9193c7708b37dfe0f350ce383b88be6af4a0f WatchSource:0}: Error finding container 97317f199862f68dc19045b17bd9193c7708b37dfe0f350ce383b88be6af4a0f: Status 404 returned error can't find the container with id 97317f199862f68dc19045b17bd9193c7708b37dfe0f350ce383b88be6af4a0f Sep 05 02:46:12.529663 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:12.529607 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" event={"ID":"cda8ede2-4b54-45cd-9825-73beba13f449","Type":"ContainerStarted","Data":"97317f199862f68dc19045b17bd9193c7708b37dfe0f350ce383b88be6af4a0f"} Sep 05 02:46:58.246353 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:46:58.246260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:47:01.939912 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:47:01.939876 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:47:18.617895 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:47:18.617851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:48:05.110152 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:05.110115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" event={"ID":"cda8ede2-4b54-45cd-9825-73beba13f449","Type":"ContainerStarted","Data":"4758159df7a95782e115dbcca2ee220208fd19d06b24c9cc1451780573fb9f38"} Sep 05 02:48:05.110576 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:05.110212 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:48:05.136982 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:05.136933 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" podStartSLOduration=1.6240711700000001 podStartE2EDuration="1m54.136916171s" totalImagesPullingTime="1m52.512845001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:48:05.135510166 +0000 UTC m=+697.750901160" watchObservedRunningTime="2026-09-05 02:48:05.136916171 +0000 UTC m=+697.752307170" Sep 05 02:48:07.117971 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:07.117939 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:48:28.123470 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:28.123427 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" podUID="cda8ede2-4b54-45cd-9825-73beba13f449" containerName="node" probeResult="failure" output="Get \"http://10.133.0.31:28080/metrics\": read tcp 10.133.0.2:42894->10.133.0.31:28080: read: connection reset by peer" Sep 05 02:48:28.217742 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:28.217710 2577 generic.go:356] "Generic (PLEG): container finished" podID="cda8ede2-4b54-45cd-9825-73beba13f449" containerID="4758159df7a95782e115dbcca2ee220208fd19d06b24c9cc1451780573fb9f38" exitCode=0 Sep 05 02:48:28.217902 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:28.217748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" event={"ID":"cda8ede2-4b54-45cd-9825-73beba13f449","Type":"ContainerDied","Data":"4758159df7a95782e115dbcca2ee220208fd19d06b24c9cc1451780573fb9f38"} Sep 05 02:48:29.364100 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:29.364073 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:48:29.417280 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:29.417187 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chk5n\" (UniqueName: \"kubernetes.io/projected/cda8ede2-4b54-45cd-9825-73beba13f449-kube-api-access-chk5n\") pod \"cda8ede2-4b54-45cd-9825-73beba13f449\" (UID: \"cda8ede2-4b54-45cd-9825-73beba13f449\") " Sep 05 02:48:29.419486 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:29.419457 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cda8ede2-4b54-45cd-9825-73beba13f449-kube-api-access-chk5n" (OuterVolumeSpecName: "kube-api-access-chk5n") pod "cda8ede2-4b54-45cd-9825-73beba13f449" (UID: "cda8ede2-4b54-45cd-9825-73beba13f449"). InnerVolumeSpecName "kube-api-access-chk5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:48:29.518772 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:29.518687 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chk5n\" (UniqueName: \"kubernetes.io/projected/cda8ede2-4b54-45cd-9825-73beba13f449-kube-api-access-chk5n\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:48:30.229272 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:30.229198 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" Sep 05 02:48:30.229428 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:30.229195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6" event={"ID":"cda8ede2-4b54-45cd-9825-73beba13f449","Type":"ContainerDied","Data":"97317f199862f68dc19045b17bd9193c7708b37dfe0f350ce383b88be6af4a0f"} Sep 05 02:48:30.229428 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:30.229331 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97317f199862f68dc19045b17bd9193c7708b37dfe0f350ce383b88be6af4a0f" Sep 05 02:48:32.321260 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:48:32.321225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:49:00.022861 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:00.022821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:49:07.429700 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.429667 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz"] Sep 05 02:49:07.430162 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.430007 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda8ede2-4b54-45cd-9825-73beba13f449" containerName="node" Sep 05 02:49:07.430162 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.430018 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda8ede2-4b54-45cd-9825-73beba13f449" containerName="node" Sep 05 02:49:07.430162 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.430090 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda8ede2-4b54-45cd-9825-73beba13f449" containerName="node" Sep 05 02:49:07.432468 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.432450 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:07.436891 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.436872 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"openshift-service-ca.crt\"" Sep 05 02:49:07.437409 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.437389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"default-dockercfg-8hdvc\"" Sep 05 02:49:07.437409 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.437407 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"kube-root-ca.crt\"" Sep 05 02:49:07.451630 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.451607 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz"] Sep 05 02:49:07.462092 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.462067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:49:07.529789 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.529763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vzp\" (UniqueName: \"kubernetes.io/projected/2c0a68d9-b30d-4798-b5ea-8546beea3c41-kube-api-access-m8vzp\") pod \"progression-invalid-node-0-0-cnpgz\" (UID: \"2c0a68d9-b30d-4798-b5ea-8546beea3c41\") " pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:07.631116 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.631073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vzp\" (UniqueName: \"kubernetes.io/projected/2c0a68d9-b30d-4798-b5ea-8546beea3c41-kube-api-access-m8vzp\") pod \"progression-invalid-node-0-0-cnpgz\" (UID: \"2c0a68d9-b30d-4798-b5ea-8546beea3c41\") " pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:07.640004 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.639971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vzp\" (UniqueName: \"kubernetes.io/projected/2c0a68d9-b30d-4798-b5ea-8546beea3c41-kube-api-access-m8vzp\") pod \"progression-invalid-node-0-0-cnpgz\" (UID: \"2c0a68d9-b30d-4798-b5ea-8546beea3c41\") " pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:07.742343 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:07.742269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:08.015372 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:08.015349 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz"] Sep 05 02:49:08.017927 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:49:08.017901 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0a68d9_b30d_4798_b5ea_8546beea3c41.slice/crio-6aad90a1ff05cc71fbcee50430a03dac3a4f5e96512c06e4218604930fbe73c6 WatchSource:0}: Error finding container 6aad90a1ff05cc71fbcee50430a03dac3a4f5e96512c06e4218604930fbe73c6: Status 404 returned error can't find the container with id 6aad90a1ff05cc71fbcee50430a03dac3a4f5e96512c06e4218604930fbe73c6 Sep 05 02:49:08.403530 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:08.403492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" event={"ID":"2c0a68d9-b30d-4798-b5ea-8546beea3c41","Type":"ContainerStarted","Data":"89b517810723a2b634528440a37a9a711e11e397d3a5b9f5c58fa0b216003ea2"} Sep 05 02:49:08.403530 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:08.403538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" event={"ID":"2c0a68d9-b30d-4798-b5ea-8546beea3c41","Type":"ContainerStarted","Data":"6aad90a1ff05cc71fbcee50430a03dac3a4f5e96512c06e4218604930fbe73c6"} Sep 05 02:49:08.403814 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:08.403578 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:08.421978 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:08.421928 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" podStartSLOduration=1.421912398 podStartE2EDuration="1.421912398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:49:08.421006024 +0000 UTC m=+761.036397020" watchObservedRunningTime="2026-09-05 02:49:08.421912398 +0000 UTC m=+761.037303394" Sep 05 02:49:10.411343 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:10.411312 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:22.378264 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:22.378233 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:49:22.971856 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:22.971818 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:49:31.409563 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:31.409467 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" podUID="2c0a68d9-b30d-4798-b5ea-8546beea3c41" containerName="node" probeResult="failure" output="Get \"http://10.133.0.32:28080/metrics\": dial tcp 10.133.0.32:28080: connect: connection refused" Sep 05 02:49:31.512350 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:31.512317 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c0a68d9-b30d-4798-b5ea-8546beea3c41" containerID="89b517810723a2b634528440a37a9a711e11e397d3a5b9f5c58fa0b216003ea2" exitCode=0 Sep 05 02:49:31.512350 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:31.512359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" event={"ID":"2c0a68d9-b30d-4798-b5ea-8546beea3c41","Type":"ContainerDied","Data":"89b517810723a2b634528440a37a9a711e11e397d3a5b9f5c58fa0b216003ea2"} Sep 05 02:49:32.640857 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:32.640834 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:32.732449 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:32.732408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8vzp\" (UniqueName: \"kubernetes.io/projected/2c0a68d9-b30d-4798-b5ea-8546beea3c41-kube-api-access-m8vzp\") pod \"2c0a68d9-b30d-4798-b5ea-8546beea3c41\" (UID: \"2c0a68d9-b30d-4798-b5ea-8546beea3c41\") " Sep 05 02:49:32.734740 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:32.734712 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0a68d9-b30d-4798-b5ea-8546beea3c41-kube-api-access-m8vzp" (OuterVolumeSpecName: "kube-api-access-m8vzp") pod "2c0a68d9-b30d-4798-b5ea-8546beea3c41" (UID: "2c0a68d9-b30d-4798-b5ea-8546beea3c41"). InnerVolumeSpecName "kube-api-access-m8vzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:49:32.832996 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:32.832966 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8vzp\" (UniqueName: \"kubernetes.io/projected/2c0a68d9-b30d-4798-b5ea-8546beea3c41-kube-api-access-m8vzp\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:49:33.523209 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:33.523173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" event={"ID":"2c0a68d9-b30d-4798-b5ea-8546beea3c41","Type":"ContainerDied","Data":"6aad90a1ff05cc71fbcee50430a03dac3a4f5e96512c06e4218604930fbe73c6"} Sep 05 02:49:33.523209 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:33.523196 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz" Sep 05 02:49:33.523424 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:49:33.523228 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6aad90a1ff05cc71fbcee50430a03dac3a4f5e96512c06e4218604930fbe73c6" Sep 05 02:50:21.762986 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:21.762868 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:50:38.805926 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.805891 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4"] Sep 05 02:50:38.806439 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.806240 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0a68d9-b30d-4798-b5ea-8546beea3c41" containerName="node" Sep 05 02:50:38.806439 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.806253 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0a68d9-b30d-4798-b5ea-8546beea3c41" containerName="node" Sep 05 02:50:38.806439 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.806330 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0a68d9-b30d-4798-b5ea-8546beea3c41" containerName="node" Sep 05 02:50:38.806745 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.806716 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:50:38.808274 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.808258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:38.810344 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.810328 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"default-dockercfg-8hdvc\"" Sep 05 02:50:38.810454 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.810356 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"kube-root-ca.crt\"" Sep 05 02:50:38.810873 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.810853 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-8w9p8\"/\"openshift-service-ca.crt\"" Sep 05 02:50:38.821762 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.821732 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4"] Sep 05 02:50:38.853197 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.853163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xq7j\" (UniqueName: \"kubernetes.io/projected/80590ebb-1874-4daf-88af-2ecd1becb622-kube-api-access-7xq7j\") pod \"progression-no-metrics-node-0-0-9cfp4\" (UID: \"80590ebb-1874-4daf-88af-2ecd1becb622\") " pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:38.953573 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.953535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xq7j\" (UniqueName: \"kubernetes.io/projected/80590ebb-1874-4daf-88af-2ecd1becb622-kube-api-access-7xq7j\") pod \"progression-no-metrics-node-0-0-9cfp4\" (UID: \"80590ebb-1874-4daf-88af-2ecd1becb622\") " pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:38.961492 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:38.961469 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xq7j\" (UniqueName: \"kubernetes.io/projected/80590ebb-1874-4daf-88af-2ecd1becb622-kube-api-access-7xq7j\") pod \"progression-no-metrics-node-0-0-9cfp4\" (UID: \"80590ebb-1874-4daf-88af-2ecd1becb622\") " pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:39.117156 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:39.117068 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:39.387990 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:39.387962 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4"] Sep 05 02:50:39.390086 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:50:39.390062 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80590ebb_1874_4daf_88af_2ecd1becb622.slice/crio-5d35832043079facd3b1ef0a07a64f2e637d396ed7a370ec9516a8e02b070b53 WatchSource:0}: Error finding container 5d35832043079facd3b1ef0a07a64f2e637d396ed7a370ec9516a8e02b070b53: Status 404 returned error can't find the container with id 5d35832043079facd3b1ef0a07a64f2e637d396ed7a370ec9516a8e02b070b53 Sep 05 02:50:39.833544 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:39.833511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" event={"ID":"80590ebb-1874-4daf-88af-2ecd1becb622","Type":"ContainerStarted","Data":"6f321536d9aca111b03cf15611d71a4d6909b4fb32095dc724c7f4c29f28ebad"} Sep 05 02:50:39.833974 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:39.833559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" event={"ID":"80590ebb-1874-4daf-88af-2ecd1becb622","Type":"ContainerStarted","Data":"5d35832043079facd3b1ef0a07a64f2e637d396ed7a370ec9516a8e02b070b53"} Sep 05 02:50:39.850230 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:39.850185 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" podStartSLOduration=1.850169958 podStartE2EDuration="1.850169958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:50:39.84846051 +0000 UTC m=+852.463851507" watchObservedRunningTime="2026-09-05 02:50:39.850169958 +0000 UTC m=+852.465560954" Sep 05 02:50:44.857726 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:44.857684 2577 generic.go:356] "Generic (PLEG): container finished" podID="80590ebb-1874-4daf-88af-2ecd1becb622" containerID="6f321536d9aca111b03cf15611d71a4d6909b4fb32095dc724c7f4c29f28ebad" exitCode=0 Sep 05 02:50:44.858170 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:44.857770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" event={"ID":"80590ebb-1874-4daf-88af-2ecd1becb622","Type":"ContainerDied","Data":"6f321536d9aca111b03cf15611d71a4d6909b4fb32095dc724c7f4c29f28ebad"} Sep 05 02:50:45.992718 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:45.992686 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:46.117000 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:46.116915 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xq7j\" (UniqueName: \"kubernetes.io/projected/80590ebb-1874-4daf-88af-2ecd1becb622-kube-api-access-7xq7j\") pod \"80590ebb-1874-4daf-88af-2ecd1becb622\" (UID: \"80590ebb-1874-4daf-88af-2ecd1becb622\") " Sep 05 02:50:46.119101 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:46.119078 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80590ebb-1874-4daf-88af-2ecd1becb622-kube-api-access-7xq7j" (OuterVolumeSpecName: "kube-api-access-7xq7j") pod "80590ebb-1874-4daf-88af-2ecd1becb622" (UID: "80590ebb-1874-4daf-88af-2ecd1becb622"). InnerVolumeSpecName "kube-api-access-7xq7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:50:46.217818 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:46.217784 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xq7j\" (UniqueName: \"kubernetes.io/projected/80590ebb-1874-4daf-88af-2ecd1becb622-kube-api-access-7xq7j\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:50:46.868381 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:46.868347 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" Sep 05 02:50:46.868562 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:46.868351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4" event={"ID":"80590ebb-1874-4daf-88af-2ecd1becb622","Type":"ContainerDied","Data":"5d35832043079facd3b1ef0a07a64f2e637d396ed7a370ec9516a8e02b070b53"} Sep 05 02:50:46.868562 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:46.868481 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d35832043079facd3b1ef0a07a64f2e637d396ed7a370ec9516a8e02b070b53" Sep 05 02:50:48.902525 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:48.902460 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:50:49.819280 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.819248 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-25dzx/must-gather-kmlnf"] Sep 05 02:50:49.819578 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.819566 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80590ebb-1874-4daf-88af-2ecd1becb622" containerName="node" Sep 05 02:50:49.819623 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.819580 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="80590ebb-1874-4daf-88af-2ecd1becb622" containerName="node" Sep 05 02:50:49.819679 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.819653 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="80590ebb-1874-4daf-88af-2ecd1becb622" containerName="node" Sep 05 02:50:49.821576 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.821560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:49.823841 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.823822 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-25dzx\"/\"openshift-service-ca.crt\"" Sep 05 02:50:49.824228 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.824214 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-25dzx\"/\"default-dockercfg-7nxsx\"" Sep 05 02:50:49.824275 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.824262 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-25dzx\"/\"kube-root-ca.crt\"" Sep 05 02:50:49.831153 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.831061 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25dzx/must-gather-kmlnf"] Sep 05 02:50:49.848084 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.848062 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:50:49.944671 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.944631 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:50:49.947933 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.947913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2f9s\" (UniqueName: \"kubernetes.io/projected/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-kube-api-access-m2f9s\") pod \"must-gather-kmlnf\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:49.948015 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:49.947989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-must-gather-output\") pod \"must-gather-kmlnf\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:50.048732 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.048702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-must-gather-output\") pod \"must-gather-kmlnf\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:50.048851 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.048743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2f9s\" (UniqueName: \"kubernetes.io/projected/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-kube-api-access-m2f9s\") pod \"must-gather-kmlnf\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:50.049010 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.048991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-must-gather-output\") pod \"must-gather-kmlnf\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:50.056198 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.056168 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2f9s\" (UniqueName: \"kubernetes.io/projected/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-kube-api-access-m2f9s\") pod \"must-gather-kmlnf\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:50.132029 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.131961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:50:50.407351 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.407326 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25dzx/must-gather-kmlnf"] Sep 05 02:50:50.409976 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:50:50.409950 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd9c2415_0157_4f9e_bbe7_10cb843a89b3.slice/crio-3e6de1abb1e52e40d4a0e548b0d80360e63a962acc2b1962387e2fe0e2f763eb WatchSource:0}: Error finding container 3e6de1abb1e52e40d4a0e548b0d80360e63a962acc2b1962387e2fe0e2f763eb: Status 404 returned error can't find the container with id 3e6de1abb1e52e40d4a0e548b0d80360e63a962acc2b1962387e2fe0e2f763eb Sep 05 02:50:50.411844 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.411827 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:50:50.887051 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:50.887013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25dzx/must-gather-kmlnf" event={"ID":"dd9c2415-0157-4f9e-bbe7-10cb843a89b3","Type":"ContainerStarted","Data":"3e6de1abb1e52e40d4a0e548b0d80360e63a962acc2b1962387e2fe0e2f763eb"} Sep 05 02:50:53.914904 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:53.914856 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6"] Sep 05 02:50:53.920757 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:53.920719 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-enabled-node-0-0-j7nw6"] Sep 05 02:50:53.928219 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:53.928194 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz"] Sep 05 02:50:53.933114 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:53.933091 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-invalid-node-0-0-cnpgz"] Sep 05 02:50:53.962242 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:53.962215 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4"] Sep 05 02:50:53.967052 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:53.967028 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-8w9p8/progression-no-metrics-node-0-0-9cfp4"] Sep 05 02:50:54.084853 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:54.084822 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:50:55.871044 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:55.871006 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0a68d9-b30d-4798-b5ea-8546beea3c41" path="/var/lib/kubelet/pods/2c0a68d9-b30d-4798-b5ea-8546beea3c41/volumes" Sep 05 02:50:55.871452 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:55.871442 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80590ebb-1874-4daf-88af-2ecd1becb622" path="/var/lib/kubelet/pods/80590ebb-1874-4daf-88af-2ecd1becb622/volumes" Sep 05 02:50:55.871878 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:55.871861 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda8ede2-4b54-45cd-9825-73beba13f449" path="/var/lib/kubelet/pods/cda8ede2-4b54-45cd-9825-73beba13f449/volumes" Sep 05 02:50:56.926036 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:56.926000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25dzx/must-gather-kmlnf" event={"ID":"dd9c2415-0157-4f9e-bbe7-10cb843a89b3","Type":"ContainerStarted","Data":"598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e"} Sep 05 02:50:56.926435 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:56.926046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25dzx/must-gather-kmlnf" event={"ID":"dd9c2415-0157-4f9e-bbe7-10cb843a89b3","Type":"ContainerStarted","Data":"be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe"} Sep 05 02:50:56.942589 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:50:56.942536 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-25dzx/must-gather-kmlnf" podStartSLOduration=1.892414807 podStartE2EDuration="7.942519358s" totalImagesPullingTime="6.050104551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:50:56.941072 +0000 UTC m=+869.556462996" watchObservedRunningTime="2026-09-05 02:50:56.942519358 +0000 UTC m=+869.557910382" Sep 05 02:51:31.385069 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:31.385008 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:31.485362 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:31.485323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:32.236556 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:32.236524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:42.175917 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:42.175882 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerID="be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe" exitCode=0 Sep 05 02:51:42.176284 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:42.175920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25dzx/must-gather-kmlnf" event={"ID":"dd9c2415-0157-4f9e-bbe7-10cb843a89b3","Type":"ContainerDied","Data":"be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe"} Sep 05 02:51:42.176284 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:42.176211 2577 scope.go:117] "RemoveContainer" containerID="be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe" Sep 05 02:51:43.074864 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:43.074831 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-25dzx_must-gather-kmlnf_dd9c2415-0157-4f9e-bbe7-10cb843a89b3/gather/0.log" Sep 05 02:51:43.450559 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:43.450458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:43.573681 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:43.573630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:43.672314 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:43.672282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:46.495067 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:46.495026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hjwtk_d9a9df36-ae83-4548-84f3-a1fa357ef62b/global-pull-secret-syncer/0.log" Sep 05 02:51:46.600806 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:46.600780 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" Sep 05 02:51:46.730588 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:46.730562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-88.ec2.internal_ad03ccc6109225d4db33f83dd3b0bcd2/haproxy/0.log" Sep 05 02:51:48.396888 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.396844 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-25dzx/must-gather-kmlnf"] Sep 05 02:51:48.397359 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.397069 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-25dzx/must-gather-kmlnf" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="copy" containerID="cri-o://598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e" gracePeriod=2 Sep 05 02:51:48.402295 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.401538 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-25dzx/must-gather-kmlnf"] Sep 05 02:51:48.632274 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.632249 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-25dzx_must-gather-kmlnf_dd9c2415-0157-4f9e-bbe7-10cb843a89b3/copy/0.log" Sep 05 02:51:48.635603 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.635255 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:51:48.643436 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:51:48.643404 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlnf\" is forbidden: User \"system:node:ip-10-0-136-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-25dzx\": no relationship found between node 'ip-10-0-136-88.ec2.internal' and this object" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:51:48.748951 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.748868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2f9s\" (UniqueName: \"kubernetes.io/projected/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-kube-api-access-m2f9s\") pod \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " Sep 05 02:51:48.749127 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.748958 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-must-gather-output\") pod \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\" (UID: \"dd9c2415-0157-4f9e-bbe7-10cb843a89b3\") " Sep 05 02:51:48.750235 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.750200 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "dd9c2415-0157-4f9e-bbe7-10cb843a89b3" (UID: "dd9c2415-0157-4f9e-bbe7-10cb843a89b3"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:51:48.751384 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.751362 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-kube-api-access-m2f9s" (OuterVolumeSpecName: "kube-api-access-m2f9s") pod "dd9c2415-0157-4f9e-bbe7-10cb843a89b3" (UID: "dd9c2415-0157-4f9e-bbe7-10cb843a89b3"). InnerVolumeSpecName "kube-api-access-m2f9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:51:48.850191 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.850166 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-must-gather-output\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:51:48.850191 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.850189 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2f9s\" (UniqueName: \"kubernetes.io/projected/dd9c2415-0157-4f9e-bbe7-10cb843a89b3-kube-api-access-m2f9s\") on node \"ip-10-0-136-88.ec2.internal\" DevicePath \"\"" Sep 05 02:51:48.901252 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.901223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:48.964121 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:48.964091 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gprhw_ba7ef29c-44b5-4f90-b95e-c1f9e6360f2f/konnectivity-agent/0.log" limit=1024 Sep 05 02:51:49.211879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.211851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-25dzx_must-gather-kmlnf_dd9c2415-0157-4f9e-bbe7-10cb843a89b3/copy/0.log" Sep 05 02:51:49.212217 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.212199 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerID="598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e" exitCode=143 Sep 05 02:51:49.212285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.212254 2577 scope.go:117] "RemoveContainer" containerID="598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e" Sep 05 02:51:49.212285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.212254 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:51:49.214244 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:51:49.214209 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlnf\" is forbidden: User \"system:node:ip-10-0-136-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-25dzx\": no relationship found between node 'ip-10-0-136-88.ec2.internal' and this object" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:51:49.220860 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.220844 2577 scope.go:117] "RemoveContainer" containerID="be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe" Sep 05 02:51:49.222073 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:51:49.222049 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kmlnf\" is forbidden: User \"system:node:ip-10-0-136-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-25dzx\": no relationship found between node 'ip-10-0-136-88.ec2.internal' and this object" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" pod="openshift-must-gather-25dzx/must-gather-kmlnf" Sep 05 02:51:49.232395 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.232376 2577 scope.go:117] "RemoveContainer" containerID="598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e" Sep 05 02:51:49.232663 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:51:49.232632 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e\": container with ID starting with 598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e not found: ID does not exist" containerID="598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e" Sep 05 02:51:49.232711 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.232673 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e"} err="failed to get container status \"598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e\": rpc error: code = NotFound desc = could not find container \"598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e\": container with ID starting with 598e86e60f977de2e0171709aee0d9c71c80a1f7518a114f6091844729e39d7e not found: ID does not exist" Sep 05 02:51:49.232711 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.232689 2577 scope.go:117] "RemoveContainer" containerID="be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe" Sep 05 02:51:49.232904 ip-10-0-136-88 kubenswrapper[2577]: E0905 02:51:49.232888 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe\": container with ID starting with be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe not found: ID does not exist" containerID="be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe" Sep 05 02:51:49.232946 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.232908 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe"} err="failed to get container status \"be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe\": rpc error: code = NotFound desc = could not find container \"be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe\": container with ID starting with be92d4677f12c1958bd4208f80e8fa372ddcf4d9384817feb7db91b683f9edfe not found: ID does not exist" Sep 05 02:51:49.869592 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:49.869563 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" path="/var/lib/kubelet/pods/dd9c2415-0157-4f9e-bbe7-10cb843a89b3/volumes" Sep 05 02:51:50.136330 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.136248 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/alertmanager/0.log" Sep 05 02:51:50.173533 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.173486 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/config-reloader/0.log" Sep 05 02:51:50.198714 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.198679 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/kube-rbac-proxy-web/0.log" Sep 05 02:51:50.234423 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.234401 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/kube-rbac-proxy/0.log" Sep 05 02:51:50.262683 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.262664 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/kube-rbac-proxy-metric/0.log" Sep 05 02:51:50.307342 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.307319 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/prom-label-proxy/0.log" Sep 05 02:51:50.332628 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.332602 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70b93a7d-f77d-4013-9788-4c9d7a8866de/init-config-reloader/0.log" Sep 05 02:51:50.404136 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.404071 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwr9p_0d454a88-0042-44f3-a24b-512ee8748739/kube-state-metrics/0.log" Sep 05 02:51:50.425879 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.425857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwr9p_0d454a88-0042-44f3-a24b-512ee8748739/kube-rbac-proxy-main/0.log" Sep 05 02:51:50.453204 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.453180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-zwr9p_0d454a88-0042-44f3-a24b-512ee8748739/kube-rbac-proxy-self/0.log" Sep 05 02:51:50.734765 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.734681 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkqz7_57aa1c20-6894-420c-b023-4aabe1680c9e/node-exporter/0.log" Sep 05 02:51:50.757576 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.757553 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkqz7_57aa1c20-6894-420c-b023-4aabe1680c9e/kube-rbac-proxy/0.log" Sep 05 02:51:50.779417 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:50.779401 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkqz7_57aa1c20-6894-420c-b023-4aabe1680c9e/init-textfile/0.log" Sep 05 02:51:51.095491 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.095461 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fg2hz_7b30bf5e-6a07-48c5-86f0-477b43a2086e/prometheus-operator/0.log" Sep 05 02:51:51.113484 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.113448 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fg2hz_7b30bf5e-6a07-48c5-86f0-477b43a2086e/kube-rbac-proxy/0.log" Sep 05 02:51:51.173094 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.173066 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5496dc49fc-r46xb_55d4fd54-b481-4103-a1b3-ffe7cdfdd474/telemeter-client/0.log" Sep 05 02:51:51.201663 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.201622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5496dc49fc-r46xb_55d4fd54-b481-4103-a1b3-ffe7cdfdd474/reload/0.log" Sep 05 02:51:51.227917 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.227893 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5496dc49fc-r46xb_55d4fd54-b481-4103-a1b3-ffe7cdfdd474/kube-rbac-proxy/0.log" Sep 05 02:51:51.259213 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.259192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/thanos-query/0.log" Sep 05 02:51:51.281196 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.281170 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy-web/0.log" Sep 05 02:51:51.301736 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.301710 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy/0.log" Sep 05 02:51:51.322587 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.322564 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/prom-label-proxy/0.log" Sep 05 02:51:51.345164 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.345145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy-rules/0.log" Sep 05 02:51:51.366573 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:51.366523 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f7cf9c7bf-ghctt_b9b7daa3-a16d-4f77-8d91-e3e4541c0860/kube-rbac-proxy-metrics/0.log" Sep 05 02:51:52.673873 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:52.673848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-489nn_0a01e8a2-87d5-45d4-b149-c5fbb9316231/networking-console-plugin/0.log" Sep 05 02:51:53.629347 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.629320 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67dbfb6bd9-wj8mz_0ec4f23d-265a-4b59-8fd1-b9786b22f6fe/console/0.log" Sep 05 02:51:53.659323 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.659293 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-6mrxp_414c553a-5df4-4526-ae1e-b3438ab7b3da/download-server/0.log" Sep 05 02:51:53.963082 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963004 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx"] Sep 05 02:51:53.963426 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963330 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="gather" Sep 05 02:51:53.963426 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963341 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="gather" Sep 05 02:51:53.963426 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963359 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="copy" Sep 05 02:51:53.963426 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963365 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="copy" Sep 05 02:51:53.963561 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963434 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="gather" Sep 05 02:51:53.963561 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.963443 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd9c2415-0157-4f9e-bbe7-10cb843a89b3" containerName="copy" Sep 05 02:51:53.966278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.966262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:53.968288 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.968269 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-chgrf\"/\"kube-root-ca.crt\"" Sep 05 02:51:53.968396 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.968276 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-chgrf\"/\"openshift-service-ca.crt\"" Sep 05 02:51:53.968752 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.968731 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-chgrf\"/\"default-dockercfg-6q2ml\"" Sep 05 02:51:53.975677 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:53.975632 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx"] Sep 05 02:51:54.091481 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.091457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-lib-modules\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.091591 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.091483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-proc\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.091591 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.091506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-sys\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.091591 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.091545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk85m\" (UniqueName: \"kubernetes.io/projected/54fac4b6-8f8b-4a87-848a-9eb758b8c877-kube-api-access-rk85m\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.091591 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.091575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-podres\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192598 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk85m\" (UniqueName: \"kubernetes.io/projected/54fac4b6-8f8b-4a87-848a-9eb758b8c877-kube-api-access-rk85m\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192750 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-podres\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192750 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-lib-modules\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192750 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-proc\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-sys\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192809 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-podres\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192847 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-proc\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-sys\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.192916 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.192875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54fac4b6-8f8b-4a87-848a-9eb758b8c877-lib-modules\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.200421 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.200402 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk85m\" (UniqueName: \"kubernetes.io/projected/54fac4b6-8f8b-4a87-848a-9eb758b8c877-kube-api-access-rk85m\") pod \"perf-node-gather-daemonset-x4zgx\" (UID: \"54fac4b6-8f8b-4a87-848a-9eb758b8c877\") " pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.276186 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.276129 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:54.549689 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:54.549625 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx"] Sep 05 02:51:54.552036 ip-10-0-136-88 kubenswrapper[2577]: W0905 02:51:54.552012 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod54fac4b6_8f8b_4a87_848a_9eb758b8c877.slice/crio-bf5a9954307e0870e535d7f0693a32dbc1e93f6c93c5bf7e20a6c889e8d40fae WatchSource:0}: Error finding container bf5a9954307e0870e535d7f0693a32dbc1e93f6c93c5bf7e20a6c889e8d40fae: Status 404 returned error can't find the container with id bf5a9954307e0870e535d7f0693a32dbc1e93f6c93c5bf7e20a6c889e8d40fae Sep 05 02:51:55.051088 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.051059 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lz7cq_180b4dbf-ae7a-4848-95af-c708e48e2c59/dns/0.log" Sep 05 02:51:55.070829 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.070806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lz7cq_180b4dbf-ae7a-4848-95af-c708e48e2c59/kube-rbac-proxy/0.log" Sep 05 02:51:55.114285 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.114267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g8k8p_6c45887b-4b18-4283-a2e5-fb412443b413/dns-node-resolver/0.log" Sep 05 02:51:55.242720 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.242694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" event={"ID":"54fac4b6-8f8b-4a87-848a-9eb758b8c877","Type":"ContainerStarted","Data":"f831b7198609b11686b497f17ba61d4c0eaecc3627317a9a34276d4742214dda"} Sep 05 02:51:55.242898 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.242747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" event={"ID":"54fac4b6-8f8b-4a87-848a-9eb758b8c877","Type":"ContainerStarted","Data":"bf5a9954307e0870e535d7f0693a32dbc1e93f6c93c5bf7e20a6c889e8d40fae"} Sep 05 02:51:55.242898 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.242835 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:51:55.259782 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.259737 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" podStartSLOduration=2.259724577 podStartE2EDuration="2.259724577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:51:55.257583888 +0000 UTC m=+927.872974884" watchObservedRunningTime="2026-09-05 02:51:55.259724577 +0000 UTC m=+927.875115615" Sep 05 02:51:55.582686 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:55.582655 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dkz5p_eecf568f-0bf5-41a6-95c9-506c30629fba/node-ca/0.log" Sep 05 02:51:56.676068 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:56.676041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sqksf_90ee08cf-b316-4875-a01b-6ec1210b9a6a/serve-healthcheck-canary/0.log" Sep 05 02:51:57.124747 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:57.124721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbk7v_557ff409-ffe5-4239-a31c-677dbe4a88ae/kube-rbac-proxy/0.log" Sep 05 02:51:57.144878 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:57.144853 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbk7v_557ff409-ffe5-4239-a31c-677dbe4a88ae/exporter/0.log" Sep 05 02:51:57.168830 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:51:57.168800 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbk7v_557ff409-ffe5-4239-a31c-677dbe4a88ae/extractor/0.log" Sep 05 02:52:01.257606 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:01.257577 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-chgrf/perf-node-gather-daemonset-x4zgx" Sep 05 02:52:03.791897 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.791821 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/kube-multus-additional-cni-plugins/0.log" Sep 05 02:52:03.811399 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.811361 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/egress-router-binary-copy/0.log" Sep 05 02:52:03.833312 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.833276 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/cni-plugins/0.log" Sep 05 02:52:03.851946 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.851923 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/bond-cni-plugin/0.log" Sep 05 02:52:03.877110 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.877073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/routeoverride-cni/0.log" Sep 05 02:52:03.896575 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.896545 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/whereabouts-cni-bincopy/0.log" Sep 05 02:52:03.916180 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.916161 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m29bp_4163c0ae-94fa-4920-bcff-8bd30ebc191d/whereabouts-cni/0.log" Sep 05 02:52:03.952716 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:03.952690 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9x4q_4232b83e-a36a-465b-aadf-9a248da4b831/kube-multus/0.log" Sep 05 02:52:04.080974 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:04.080947 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jb25h_854d055e-baf8-4237-8ae9-89a7fdb67e00/network-metrics-daemon/0.log" Sep 05 02:52:04.099074 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:04.099048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jb25h_854d055e-baf8-4237-8ae9-89a7fdb67e00/kube-rbac-proxy/0.log" Sep 05 02:52:04.949031 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:04.949000 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/ovn-controller/0.log" Sep 05 02:52:04.965099 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:04.965074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/ovn-acl-logging/0.log" Sep 05 02:52:04.987278 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:04.987261 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/kube-rbac-proxy-node/0.log" Sep 05 02:52:05.007036 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:05.007019 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/kube-rbac-proxy-ovn-metrics/0.log" Sep 05 02:52:05.025984 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:05.025950 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/northd/0.log" Sep 05 02:52:05.048291 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:05.048241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/nbdb/0.log" Sep 05 02:52:05.071066 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:05.071048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/sbdb/0.log" Sep 05 02:52:05.129129 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:05.129106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqljf_45163ac3-87c9-4121-a180-5fb3a6d3fced/ovnkube-controller/0.log" Sep 05 02:52:06.451023 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:06.450995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2t4m9_9b79a834-3270-4b5e-902e-d03953fc571b/network-check-target-container/0.log" Sep 05 02:52:07.524134 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:07.524108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-c7g2g_1e795840-b0db-4357-ab60-dbbedb7d2d2e/iptables-alerter/0.log" Sep 05 02:52:08.175421 ip-10-0-136-88 kubenswrapper[2577]: I0905 02:52:08.175394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vktzt_ffe394e6-4404-4039-b7b7-a401c5ec2373/tuned/0.log"