Sep 09 21:06:06.253837 ip-10-0-141-64 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 21:06:06.253849 ip-10-0-141-64 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 21:06:06.253858 ip-10-0-141-64 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 21:06:06.254057 ip-10-0-141-64 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 21:06:16.328877 ip-10-0-141-64 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 21:06:16.328899 ip-10-0-141-64 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dad5bbb77baf48d4ac136de099eb1ef8 --
Sep 09 21:08:15.258817 ip-10-0-141-64 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 21:08:15.648540 ip-10-0-141-64 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:08:15.648540 ip-10-0-141-64 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 21:08:15.648540 ip-10-0-141-64 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:08:15.648540 ip-10-0-141-64 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 21:08:15.648540 ip-10-0-141-64 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 21:08:15.649240 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.648643    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 21:08:15.653826 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653808    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:08:15.653826 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653825    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653829    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653832    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653835    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653839    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653841    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653844    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653847    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653850    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653852    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653855    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653858    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653861    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653864    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653866    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653869    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653872    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653874    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653878    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653881    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:08:15.653897 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653884    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653886    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653889    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653892    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653894    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653897    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653900    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653902    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653905    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653908    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653911    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653914    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653916    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653919    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653921    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653924    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653927    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653929    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653932    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653934    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:08:15.654384 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653937    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653940    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653943    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653945    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653948    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653950    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653953    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653955    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653958    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653961    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653963    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653966    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653968    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653971    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653974    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653977    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653980    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653983    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653985    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653987    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653990    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:08:15.655053 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653992    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653995    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.653997    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654000    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654002    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654005    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654007    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654011    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654015    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654018    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654020    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654023    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654025    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654028    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654031    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654033    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654036    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654038    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654042    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:08:15.655715 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654045    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654048    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654050    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654053    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654055    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654057    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654061    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654063    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654066    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654069    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654071    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654076    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654080    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654084    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654087    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654090    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654093    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654096    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654837    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:08:15.656211 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654845    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654848    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654851    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654853    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654857    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654860    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654862    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654864    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654868    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654871    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654874    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654877    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654880    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654882    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654887    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654891    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654894    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654897    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654900    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:08:15.656705 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654904    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654907    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654910    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654913    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654916    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654919    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654922    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654925    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654929    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654932    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654934    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654937    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654939    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654942    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654944    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654947    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654950    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654953    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654956    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654958    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654961    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:08:15.657193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654963    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654966    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654969    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654971    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654975    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654979    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654981    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654985    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654987    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654990    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654993    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.654997    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655000    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655003    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655005    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655008    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655010    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655013    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655015    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:08:15.657743 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655018    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655020    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655022    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655025    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655027    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655030    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655032    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655036    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655039    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655041    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655044    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655046    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655048    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655052    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655055    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655058    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655060    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655063    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655066    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655069    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:08:15.658205 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655072    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655074    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655077    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655079    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655082    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655084    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655087    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655090    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655094    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655096    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655099    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655101    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655104    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655106    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655108    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655111    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655113    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655116    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655118    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:08:15.658725 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655488    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655515    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655518    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655521    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655523    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655526    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655528    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655531    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655535    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655537    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655540    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655543    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655545    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655549    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655551    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655554    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655557    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655559    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655562    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655565    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:08:15.659193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655567    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655570    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655572    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655575    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655577    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655580    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655582    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655585    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655588    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655590    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655592    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655595    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655598    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655601    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655604    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655606    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655609    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655611    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655614    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655616    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:08:15.659719 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655618    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655627    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655630    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655632    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655635    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655638    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655641    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655643    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655648    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655652    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655655    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655657    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655660    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655663    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655666    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655669    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655671    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655674    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655676    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655679    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:08:15.660225 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655681    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655684    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655686    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655689    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655692    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655695    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655697    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655700    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655702    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655705    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655708    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655710    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655713    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655715    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655718    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655721    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655724    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655727    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655730    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655732    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:08:15.660779 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655735    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655737    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655740    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655742    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655746    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655749    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655752    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655756    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655759    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655763    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655766    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655768    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655771    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655774    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655776    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655779    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655784    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655787    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.655789    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:08:15.661308 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655860    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655897    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655903    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655907    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655912    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655915    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655919    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655925    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655929    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655932    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655935    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655938    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655942    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655945    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655947    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655950    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655953    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655956    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655960    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655963    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655966    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655969    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655973    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655976    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 21:08:15.661802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655979    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655982    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655986    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655989    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655992    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655996    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.655999    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656002    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656006    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656009    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656012    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656015    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656018    2580 flags.go:64] FLAG: --enable-server="true"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656020    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656025    2580 flags.go:64] FLAG: --event-burst="100"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656029    2580 flags.go:64] FLAG: --event-qps="50"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656032    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656036    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656039    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656043    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656046    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656048    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656051    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656054    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656057    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 21:08:15.662369 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656060    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656062    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656065    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656067    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656071    2580 flags.go:64] FLAG: --feature-gates=""
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656075    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656077    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656081    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656084    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656087    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656090    2580 flags.go:64] FLAG: --help="false"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656092    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-141-64.ec2.internal"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656097    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656100    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656103    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656106    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656110    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656112    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656115    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656118    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656121    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656123    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656128    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656131    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 09 21:08:15.663061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656133    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656139    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656142    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656145    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656148    2580 flags.go:64] FLAG: --lock-file=""
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656150    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656153    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656156    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656162    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656165    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656167    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656170    2580 flags.go:64] FLAG: --logging-format="text"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656173    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656176    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656179    2580 flags.go:64] FLAG: --manifest-url=""
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656182    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656186    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656189    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656193    2580 flags.go:64] FLAG: --max-pods="110"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656196    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656200    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656203    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656206    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656208    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656211    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 21:08:15.663700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656214    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656222    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656224    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656228    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656231    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656235    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656240    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656243    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656247    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656250    2580 flags.go:64] FLAG: --port="10250"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656253    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656256    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dc389b89476230a8"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656259    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656262    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656265    2580 flags.go:64] FLAG: --register-node="true"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656267    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656271    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656274    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656276    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656279    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656285    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656288    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656291    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656293    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656296    2580 flags.go:64] FLAG: --runonce="false"
Sep 09 21:08:15.664318 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656299    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656302    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656306    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656309    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656312    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656315    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656318    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656321    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656323    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656326    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656329    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656332    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656334    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656339    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656341    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656347    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656349    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656353    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656357    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656360    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656363    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656365    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656368    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656371    2580 flags.go:64] FLAG: --v="2"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656375    2580 flags.go:64] FLAG: --version="false"
Sep 09 21:08:15.664974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656378    2580 flags.go:64] FLAG: --vmodule=""
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656382    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.656385    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656521    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656525    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656529    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656532    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656534    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656537    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656541    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656544    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656547    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656549    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656552    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656554    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656557    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656559    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656562    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656566    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656570    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:08:15.665619 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656576    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656579    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656581    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656584    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656587    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656596    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656599    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656602    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656604    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656606    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656609    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656612    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656615    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656617    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656620    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656622    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656626    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656629    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656632    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656635    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:08:15.666129 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656638    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656641    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656644    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656646    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656649    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656652    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656655    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656657    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656660    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656662    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656665    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656667    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656672    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656674    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656677    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656679    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656683    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656685    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656689    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656692    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:08:15.666679 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656694    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656697    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656699    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656701    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656704    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656707    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656710    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656712    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656715    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656718    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656721    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656723    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656726    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656730    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656732    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656735    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656737    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656740    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656742    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656745    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:08:15.667169 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656747    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656750    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656752    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656763    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656767    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656770    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656772    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656775    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656777    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656780    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656782    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656786    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656789    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656791    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656794    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656798    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656801    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656804    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:08:15.667680 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656807    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656811    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656814    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.656817    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.657300    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.664828    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.664844    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.664860    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.664869    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664940    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664946    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664949    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664953    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664956    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:08:15.668114 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664960    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664964    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664968    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664971    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664975    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664978    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664981    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664984    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664987    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664991    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664994    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.664997    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665002    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665006    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665009    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665012    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665015    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665018    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665021    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:08:15.668463 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665023    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665026    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665029    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665031    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665034    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665037    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665040    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665044    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665047    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665051    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665054    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665057    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665059    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665062    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665065    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665067    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665070    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665073    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665075    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665078    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:08:15.668957 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665080    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665083    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665086    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665089    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665092    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665095    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665098    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665100    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665103    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665106    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665108    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665111    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665113    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665116    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665118    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665121    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665123    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665126    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665129    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665131    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:08:15.669440 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665134    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665136    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665139    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665141    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665144    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665147    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665149    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665152    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665154    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665157    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665159    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665161    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665164    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665166    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665169    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665172    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665175    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665178    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665181    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665184    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:08:15.669987 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665186    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665188    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665191    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665193    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665196    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665198    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665201    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665204    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665206    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665209    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665211    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665214    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665216    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665218    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665221    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:08:15.670477 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.665226    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665345    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665350    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665353    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665356    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665359    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665361    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665364    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665367    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665369    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665371    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665374    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665376    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665380    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665382    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665384    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665387    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665390    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665392    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665395    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 21:08:15.670896 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665397    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665400    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665403    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665406    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665409    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665411    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665414    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665416    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665419    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665421    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665424    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665426    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665430    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665433    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665436    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665439    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665442    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665444    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665447    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665450    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 21:08:15.671379 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665452    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665455    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665457    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665460    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665462    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665464    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665467    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665469    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665472    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665474    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665477    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665480    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665482    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665484    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665487    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665490    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665510    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665513    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665515    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 21:08:15.671979 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665518    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665520    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665523    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665525    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665528    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665530    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665533    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665535    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665538    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665540    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665543    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665545    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665548    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665551    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665553    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665555    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665558    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665560    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665563    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 21:08:15.672436 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665567    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665570    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665573    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665576    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665579    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665581    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665584    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665586    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665589    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665592    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665594    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665597    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665599    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665602    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665604    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665607    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665609    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665612    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665614    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665617    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 21:08:15.672931 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665619    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:15.665622    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.665627    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.665738    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.667635    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.668350    2580 server.go:1019] "Starting client certificate rotation"
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.668451    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.668536    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 21:08:15.673521 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.670609    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 21:08:15.676222 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.676201    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 21:08:15.684828 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.684810    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 09 21:08:15.688231 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.688216    2580 log.go:25] "Validated CRI v1 image API"
Sep 09 21:08:15.690238 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.690207    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 21:08:15.693428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.693409    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81f90abc-2b94-4883-a5c3-495c1a526057:/dev/nvme0n1p3 ec6eea06-e14a-4708-8a3e-16af309cb648:/dev/nvme0n1p4]
Sep 09 21:08:15.693515 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.693428    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 21:08:15.698749 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.698639    2580 manager.go:216] Machine: {Timestamp:2026-09-09 21:08:15.697524951 +0000 UTC m=+0.327635179 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092241 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20cdf1997987f2a36a64bdd9005c8b SystemUUID:ec20cdf1-9979-87f2-a36a-64bdd9005c8b BootID:dad5bbb7-7baf-48d4-ac13-6de099eb1ef8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:4d:83:ee:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:4d:83:ee:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:a3:e6:c4:87:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 21:08:15.698749 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.698747    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 21:08:15.698864 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.698825    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 21:08:15.701650 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.701622    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 21:08:15.701808 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.701658    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 21:08:15.702351 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.702340    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 21:08:15.702382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.702352    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 21:08:15.702382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.702361    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 21:08:15.703073 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.703063    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 21:08:15.703786 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.703776    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 21:08:15.704693 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.704677    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 21:08:15.708998 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.708984    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 21:08:15.709119 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709110    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 21:08:15.709149 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709140    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 21:08:15.709177 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709153    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 21:08:15.709212 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709179    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 21:08:15.709212 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709193    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 09 21:08:15.709212 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709204    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 21:08:15.709564 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709552    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 21:08:15.709622 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.709579    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 21:08:15.711782 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.711766    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 21:08:15.713845 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.713830    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 21:08:15.713902 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.713861    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 21:08:15.715433 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715421    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 21:08:15.715480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715440    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 21:08:15.715480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715446    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 21:08:15.715480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715452    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 21:08:15.715480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715460    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 21:08:15.715480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715465    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 21:08:15.715480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715479    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 21:08:15.715659 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715484    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 21:08:15.715659 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715491    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 21:08:15.715659 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715511    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 21:08:15.715659 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715519    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 21:08:15.715659 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.715525    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 21:08:15.716332 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.716312    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 21:08:15.716332 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.716324    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 21:08:15.720693 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.720675    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 21:08:15.720778 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.720687    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 21:08:15.721130 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.721107    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 21:08:15.721394 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.721372    2580 server.go:1268] "Started kubelet"
Sep 09 21:08:15.721485 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.721461    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 21:08:15.721573 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.721526    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 21:08:15.721614 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.721598    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 21:08:15.722420 ip-10-0-141-64 systemd[1]: Started Kubernetes Kubelet.
Sep 09 21:08:15.722978 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.722630    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 21:08:15.723716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.723592    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 21:08:15.726994 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.726972    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 21:08:15.728305 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728290    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 21:08:15.728305 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728303    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 21:08:15.728484 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.728427    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:15.728892 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728875    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 21:08:15.728892 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728878    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 21:08:15.729038 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728905    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 21:08:15.729038 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728962    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 21:08:15.729038 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.728971    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 21:08:15.729280 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729266    2580 factory.go:55] Registering systemd factory
Sep 09 21:08:15.729334 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729287    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 09 21:08:15.729538 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729523    2580 factory.go:153] Registering CRI-O factory
Sep 09 21:08:15.729538 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729538    2580 factory.go:223] Registration of the crio container factory successfully
Sep 09 21:08:15.729656 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729576    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 21:08:15.729656 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729589    2580 factory.go:103] Registering Raw factory
Sep 09 21:08:15.729656 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729602    2580 manager.go:1196] Started watching for new ooms in manager
Sep 09 21:08:15.729906 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.729896    2580 manager.go:349] Starting recovery of all containers
Sep 09 21:08:15.734484 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.734265    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 21:08:15.734647 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.734627    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 21:08:15.736745 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.734548    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-64.ec2.internal.18d3c331d0df5d49  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-64.ec2.internal,UID:ip-10-0-141-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-64.ec2.internal,},FirstTimestamp:2026-09-09 21:08:15.721332041 +0000 UTC m=+0.351442270,LastTimestamp:2026-09-09 21:08:15.721332041 +0000 UTC m=+0.351442270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-64.ec2.internal,}"
Sep 09 21:08:15.741852 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.741831    2580 manager.go:354] Recovery completed
Sep 09 21:08:15.743762 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.743722    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4p8td"
Sep 09 21:08:15.748733 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.748718    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.750546 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.750474    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.750546 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.750532    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.750661 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.750548    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.751190 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.751172    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 21:08:15.751190 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.751186    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.751306 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.751225    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4p8td"
Sep 09 21:08:15.751306 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.751188    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 21:08:15.751306 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.751303    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 21:08:15.752032 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.752017    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.752086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.752044    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.752086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.752055    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.754151 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.754086    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-64.ec2.internal.18d3c331d29ca652  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-64.ec2.internal,UID:ip-10-0-141-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-64.ec2.internal,},FirstTimestamp:2026-09-09 21:08:15.750514258 +0000 UTC m=+0.380624490,LastTimestamp:2026-09-09 21:08:15.750514258 +0000 UTC m=+0.380624490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-64.ec2.internal,}"
Sep 09 21:08:15.754338 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.754325    2580 policy_none.go:49] "None policy: Start"
Sep 09 21:08:15.754400 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.754346    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 21:08:15.754400 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.754359    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 21:08:15.756296 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.756284    2580 policy_none.go:47] "Start"
Sep 09 21:08:15.789264 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789245    2580 manager.go:337] "Starting Device Plugin manager"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.789296    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789311    2580 server.go:87] "Starting device plugin registration server"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789672    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789685    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789790    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789876    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.789889    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.790386    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 21:08:15.815606 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.790425    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:15.868689 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.868640    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 21:08:15.870081 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.870051    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 21:08:15.870192 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.870119    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 21:08:15.870192 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.870153    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 21:08:15.870299 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.870193    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 21:08:15.872663 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.872642    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:08:15.890555 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.890535    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.891510 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.891479    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.891621 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.891527    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.891621 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.891558    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.891621 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.891588    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-64.ec2.internal"
Sep 09 21:08:15.898383 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.898365    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-64.ec2.internal"
Sep 09 21:08:15.898469 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.898393    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-64.ec2.internal\": node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:15.921990 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.921903    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:15.971029 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.970993    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"]
Sep 09 21:08:15.971178 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.971071    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.972609 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.972594    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.972699 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.972626    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.972699 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.972636    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.974907 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.974895    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.975009 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.974994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:15.975070 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975021    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.975638 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975620    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.975746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975652    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.975746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975668    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.975746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975673    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.975746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975693    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.975746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.975703    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.977859 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.977844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:15.977937 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.977870    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 21:08:15.978515 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.978484    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 21:08:15.978578 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.978524    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 21:08:15.978578 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:15.978539    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeHasSufficientPID"
Sep 09 21:08:15.997106 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:15.997080    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-64.ec2.internal\" not found" node="ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.001383 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.001366    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-64.ec2.internal\" not found" node="ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.022519 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.022485    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:16.030883 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.030860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5995e8255ba8e9ba7eb911beeb5d5b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal\" (UID: \"d5995e8255ba8e9ba7eb911beeb5d5b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.030977 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.030893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5995e8255ba8e9ba7eb911beeb5d5b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal\" (UID: \"d5995e8255ba8e9ba7eb911beeb5d5b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.030977 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.030930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4392e07847543f3d7d91590de7915159-config\") pod \"kube-apiserver-proxy-ip-10-0-141-64.ec2.internal\" (UID: \"4392e07847543f3d7d91590de7915159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.123066 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.123034    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:16.131410 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.131384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4392e07847543f3d7d91590de7915159-config\") pod \"kube-apiserver-proxy-ip-10-0-141-64.ec2.internal\" (UID: \"4392e07847543f3d7d91590de7915159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.131467 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.131415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5995e8255ba8e9ba7eb911beeb5d5b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal\" (UID: \"d5995e8255ba8e9ba7eb911beeb5d5b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.131467 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.131434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5995e8255ba8e9ba7eb911beeb5d5b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal\" (UID: \"d5995e8255ba8e9ba7eb911beeb5d5b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.131548 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.131477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5995e8255ba8e9ba7eb911beeb5d5b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal\" (UID: \"d5995e8255ba8e9ba7eb911beeb5d5b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.131548 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.131527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4392e07847543f3d7d91590de7915159-config\") pod \"kube-apiserver-proxy-ip-10-0-141-64.ec2.internal\" (UID: \"4392e07847543f3d7d91590de7915159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.131548 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.131536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5995e8255ba8e9ba7eb911beeb5d5b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal\" (UID: \"d5995e8255ba8e9ba7eb911beeb5d5b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.223541 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.223422    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:16.299012 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.298977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.304733 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.304254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.324118 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.324088    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:16.424611 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.424570    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:16.525228 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.525149    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-64.ec2.internal\" not found"
Sep 09 21:08:16.612330 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.612297    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:08:16.628685 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.628661    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.640472 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.640454    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 21:08:16.642047 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.642033    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal"
Sep 09 21:08:16.654475 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.654453    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 21:08:16.668634 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.668610    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 21:08:16.668792 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.668774    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 21:08:16.668838 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.668795    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 21:08:16.709968 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.709936    2580 apiserver.go:52] "Watching apiserver"
Sep 09 21:08:16.728473 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.728447    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 21:08:16.728696 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.728559    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:08:16.732020 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.731645    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 21:08:16.733280 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.733256    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal","openshift-multus/network-metrics-daemon-lvlqx","openshift-network-diagnostics/network-check-target-7tdb4","openshift-network-operator/iptables-alerter-w65bw","openshift-ovn-kubernetes/ovnkube-node-v5xc4","kube-system/konnectivity-agent-g29wp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w","openshift-cluster-node-tuning-operator/tuned-bsf6r","openshift-dns/node-resolver-hhpzm","openshift-image-registry/node-ca-dhhk5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal","openshift-multus/multus-additional-cni-plugins-l9rgh","openshift-multus/multus-cdptc","kube-system/global-pull-secret-syncer-kwhf8"]
Sep 09 21:08:16.735590 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.735574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:16.735677 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.735660    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:16.737741 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.737721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:16.737836 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.737798    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:16.739838 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.739816    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:16.743026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.743002    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.743434 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.743318    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.743434 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.743374    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.743622 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.743440    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 21:08:16.743796 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.743779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h9gdr\""
Sep 09 21:08:16.745137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.745121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:16.746930 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.746912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 21:08:16.746930 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.746931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 21:08:16.747078 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.746948    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-llmdx\""
Sep 09 21:08:16.747078 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.746989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 21:08:16.747078 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.747005    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.747078 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.746932    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.747272 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.746921    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 21:08:16.747327 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.747286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.747431 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.747413    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 21:08:16.747934 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.747917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-26d4k\""
Sep 09 21:08:16.748106 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.748089    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 21:08:16.748519 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.748490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 21:08:16.749538 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.749524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.751891 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.751833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.751891 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.751861    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 21:08:16.752061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.751921    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p8grp\""
Sep 09 21:08:16.752061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.751888    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.752061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.751981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:16.752061 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.752018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s74b4\""
Sep 09 21:08:16.752252 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.752186    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.752449 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.752437    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.754332 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.754316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:16.754942 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.754914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kpqkf\""
Sep 09 21:08:16.755081 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.755069    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.755128 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.755078    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.755407 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.755377    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 21:03:16 +0000 UTC" deadline="2028-04-06 21:38:13.22671775 +0000 UTC"
Sep 09 21:08:16.755451 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.755409    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13800h29m56.471311606s"
Sep 09 21:08:16.757142 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.757124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.757244 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.757186    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.758248 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.758224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.758357 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.758258    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 21:08:16.758483 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.758470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jfv6q\""
Sep 09 21:08:16.759556 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.759539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.760673 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.760654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 21:08:16.761022 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.761002    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 21:08:16.761373 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.761338    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 21:08:16.761373 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.761378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 21:08:16.761599 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.761420    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zvl99\""
Sep 09 21:08:16.761742 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.761725    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 21:08:16.762724 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.762686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9cc4x\""
Sep 09 21:08:16.762724 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.762719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:16.762865 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:16.762794    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:16.763101 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.763083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 21:08:16.777817 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.777767    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2bj4t"
Sep 09 21:08:16.785768 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.785746    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2bj4t"
Sep 09 21:08:16.829710 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.829693    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 21:08:16.835617 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3564149b-9897-4710-8c88-85e0a97263db-etc-tuned\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.835716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cnibin\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.835716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:16.835716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc0f37c8-6b62-4fcd-b3ce-1037223375ce-agent-certs\") pod \"konnectivity-agent-g29wp\" (UID: \"cc0f37c8-6b62-4fcd-b3ce-1037223375ce\") " pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:16.835866 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b86400ed-a9f6-4343-93f4-2c96953811b7-cni-binary-copy\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.835866 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-netns\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.835866 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-conf-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.835866 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-cni-netd\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovn-node-metrics-cert\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-cni-bin\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-var-lib-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.835996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-registration-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysconfig\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-host\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b35cf4a-843a-4f93-863b-a58b691a0160-hosts-file\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-socket-dir-parent\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-cnibin\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-kubelet\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-kubernetes\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysctl-conf\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-lib-modules\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b35cf4a-843a-4f93-863b-a58b691a0160-tmp-dir\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-system-cni-dir\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-hostroot\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-sys-fs\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gb8\" (UniqueName: \"kubernetes.io/projected/9b35cf4a-843a-4f93-863b-a58b691a0160-kube-api-access-59gb8\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b7c6098-17b4-46a2-b8ee-570590c8f867-serviceca\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-slash\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-systemd\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-cni-bin\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-run-netns\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-systemd\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-etc-kubernetes\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1068620-d122-49bf-80fa-01755da20901-dbus\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-kubelet\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-socket-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-sys\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgj2s\" (UniqueName: \"kubernetes.io/projected/3b7c6098-17b4-46a2-b8ee-570590c8f867-kube-api-access-cgj2s\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-cni-multus\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5827l\" (UniqueName: \"kubernetes.io/projected/1c4776c4-4c10-4206-8766-1f369f0497b1-kube-api-access-5827l\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:16.836954 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b7c6098-17b4-46a2-b8ee-570590c8f867-host\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.836970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-cni-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c4776c4-4c10-4206-8766-1f369f0497b1-iptables-alerter-script\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c4776c4-4c10-4206-8766-1f369f0497b1-host-slash\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-etc-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-env-overrides\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-system-cni-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-multus-certs\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-ovn\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovnkube-config\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckf2h\" (UniqueName: \"kubernetes.io/projected/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-kube-api-access-ckf2h\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlp8m\" (UniqueName: \"kubernetes.io/projected/3564149b-9897-4710-8c88-85e0a97263db-kube-api-access-dlp8m\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.837336 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjbx\" (UniqueName: \"kubernetes.io/projected/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-kube-api-access-4cjbx\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc0f37c8-6b62-4fcd-b3ce-1037223375ce-konnectivity-ca\") pod \"konnectivity-agent-g29wp\" (UID: \"cc0f37c8-6b62-4fcd-b3ce-1037223375ce\") " pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bhkw\" (UniqueName: \"kubernetes.io/projected/b86400ed-a9f6-4343-93f4-2c96953811b7-kube-api-access-9bhkw\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-device-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovnkube-script-lib\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-k8s-cni-cncf-io\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-daemon-config\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1068620-d122-49bf-80fa-01755da20901-kubelet-config\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-node-log\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3564149b-9897-4710-8c88-85e0a97263db-tmp\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzqt\" (UniqueName: \"kubernetes.io/projected/9e9802d4-8b0b-42f7-8be7-779d96efe850-kube-api-access-4gzqt\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-systemd-units\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcn2\" (UniqueName: \"kubernetes.io/projected/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-kube-api-access-sxcn2\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.837729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:16.838196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-modprobe-d\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.838196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-run\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.838196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-var-lib-kubelet\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.838196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.838196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-log-socket\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:16.838196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.837850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysctl-d\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:16.898059 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:16.898032    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4392e07847543f3d7d91590de7915159.slice/crio-b0326d580724a7fe128b4944720b3702323b8a76764cbdbf4a4fc4ab3171852e WatchSource:0}: Error finding container b0326d580724a7fe128b4944720b3702323b8a76764cbdbf4a4fc4ab3171852e: Status 404 returned error can't find the container with id b0326d580724a7fe128b4944720b3702323b8a76764cbdbf4a4fc4ab3171852e
Sep 09 21:08:16.898277 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:16.898263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5995e8255ba8e9ba7eb911beeb5d5b7.slice/crio-0e14860dee7a6dd63c72f517a49b016921ffe60307ce35d8ce689687d7fcb58a WatchSource:0}: Error finding container 0e14860dee7a6dd63c72f517a49b016921ffe60307ce35d8ce689687d7fcb58a: Status 404 returned error can't find the container with id 0e14860dee7a6dd63c72f517a49b016921ffe60307ce35d8ce689687d7fcb58a
Sep 09 21:08:16.904193 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:16.904174    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:08:18.092516 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.092516 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-cni-multus\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5827l\" (UniqueName: \"kubernetes.io/projected/1c4776c4-4c10-4206-8766-1f369f0497b1-kube-api-access-5827l\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b7c6098-17b4-46a2-b8ee-570590c8f867-host\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-cni-multus\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-cni-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c4776c4-4c10-4206-8766-1f369f0497b1-iptables-alerter-script\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c4776c4-4c10-4206-8766-1f369f0497b1-host-slash\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.092703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-etc-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-env-overrides\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b7c6098-17b4-46a2-b8ee-570590c8f867-host\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-cni-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-etc-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-system-cni-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-multus-certs\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-ovn\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c4776c4-4c10-4206-8766-1f369f0497b1-host-slash\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovnkube-config\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-multus-certs\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.092975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckf2h\" (UniqueName: \"kubernetes.io/projected/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-kube-api-access-ckf2h\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlp8m\" (UniqueName: \"kubernetes.io/projected/3564149b-9897-4710-8c88-85e0a97263db-kube-api-access-dlp8m\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-ovn\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-system-cni-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjbx\" (UniqueName: \"kubernetes.io/projected/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-kube-api-access-4cjbx\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-env-overrides\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc0f37c8-6b62-4fcd-b3ce-1037223375ce-konnectivity-ca\") pod \"konnectivity-agent-g29wp\" (UID: \"cc0f37c8-6b62-4fcd-b3ce-1037223375ce\") " pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bhkw\" (UniqueName: \"kubernetes.io/projected/b86400ed-a9f6-4343-93f4-2c96953811b7-kube-api-access-9bhkw\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-device-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovnkube-script-lib\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovnkube-config\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-k8s-cni-cncf-io\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c4776c4-4c10-4206-8766-1f369f0497b1-iptables-alerter-script\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-daemon-config\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-device-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-k8s-cni-cncf-io\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1068620-d122-49bf-80fa-01755da20901-kubelet-config\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:18.093708 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-node-log\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3564149b-9897-4710-8c88-85e0a97263db-tmp\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc0f37c8-6b62-4fcd-b3ce-1037223375ce-konnectivity-ca\") pod \"konnectivity-agent-g29wp\" (UID: \"cc0f37c8-6b62-4fcd-b3ce-1037223375ce\") " pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1068620-d122-49bf-80fa-01755da20901-kubelet-config\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-node-log\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzqt\" (UniqueName: \"kubernetes.io/projected/9e9802d4-8b0b-42f7-8be7-779d96efe850-kube-api-access-4gzqt\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-systemd-units\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcn2\" (UniqueName: \"kubernetes.io/projected/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-kube-api-access-sxcn2\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.093867    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-modprobe-d\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-run\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.093954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:18.593933965 +0000 UTC m=+2.069626952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-systemd-units\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.094554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-var-lib-kubelet\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.093988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-run\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-modprobe-d\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-var-lib-kubelet\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovnkube-script-lib\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-log-socket\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-log-socket\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysctl-d\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3564149b-9897-4710-8c88-85e0a97263db-etc-tuned\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cnibin\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-daemon-config\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc0f37c8-6b62-4fcd-b3ce-1037223375ce-agent-certs\") pod \"konnectivity-agent-g29wp\" (UID: \"cc0f37c8-6b62-4fcd-b3ce-1037223375ce\") " pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b86400ed-a9f6-4343-93f4-2c96953811b7-cni-binary-copy\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-netns\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.095274 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-conf-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysctl-d\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-conf-dir\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-run-netns\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-cni-netd\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-cni-netd\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094411    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovn-node-metrics-cert\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-cni-bin\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-var-lib-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-cni-bin\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-registration-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysconfig\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-host\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.096004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-var-lib-openvswitch\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b35cf4a-843a-4f93-863b-a58b691a0160-hosts-file\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-socket-dir-parent\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-cnibin\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b35cf4a-843a-4f93-863b-a58b691a0160-hosts-file\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-kubelet\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-kubernetes\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b86400ed-a9f6-4343-93f4-2c96953811b7-cni-binary-copy\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysctl-conf\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-host-var-lib-kubelet\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-kubernetes\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysconfig\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-lib-modules\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b35cf4a-843a-4f93-863b-a58b691a0160-tmp-dir\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-multus-socket-dir-parent\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-system-cni-dir\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.097102 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-sysctl-conf\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-hostroot\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-sys-fs\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gb8\" (UniqueName: \"kubernetes.io/projected/9b35cf4a-843a-4f93-863b-a58b691a0160-kube-api-access-59gb8\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b7c6098-17b4-46a2-b8ee-570590c8f867-serviceca\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-lib-modules\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-slash\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-slash\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-systemd\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-cni-bin\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-host\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-run-netns\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-systemd\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.095190    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-etc-kubernetes\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.095241    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:18.595228095 +0000 UTC m=+2.070921071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-hostroot\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.097944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-cnibin\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-sys-fs\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-etc-systemd\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-cni-bin\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-run-netns\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-run-systemd\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-cnibin\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-system-cni-dir\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.094606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-registration-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b86400ed-a9f6-4343-93f4-2c96953811b7-etc-kubernetes\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b35cf4a-843a-4f93-863b-a58b691a0160-tmp-dir\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1068620-d122-49bf-80fa-01755da20901-dbus\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-kubelet\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-socket-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1068620-d122-49bf-80fa-01755da20901-dbus\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-sys\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgj2s\" (UniqueName: \"kubernetes.io/projected/3b7c6098-17b4-46a2-b8ee-570590c8f867-kube-api-access-cgj2s\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-host-kubelet\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.098607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3564149b-9897-4710-8c88-85e0a97263db-sys\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.099117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b7c6098-17b4-46a2-b8ee-570590c8f867-serviceca\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.099117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.095771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-socket-dir\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.099117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.098293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3564149b-9897-4710-8c88-85e0a97263db-etc-tuned\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.099117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.098494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-ovn-node-metrics-cert\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.099117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.098650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc0f37c8-6b62-4fcd-b3ce-1037223375ce-agent-certs\") pod \"konnectivity-agent-g29wp\" (UID: \"cc0f37c8-6b62-4fcd-b3ce-1037223375ce\") " pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:18.099413 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.099385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3564149b-9897-4710-8c88-85e0a97263db-tmp\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.102185 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.102168    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:18.102286 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.102190    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:18.102286 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.102203    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:18.102286 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.102276    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:08:18.602259614 +0000 UTC m=+2.077952611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:18.104951 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.104442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcn2\" (UniqueName: \"kubernetes.io/projected/fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795-kube-api-access-sxcn2\") pod \"ovnkube-node-v5xc4\" (UID: \"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.104951 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.104704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlp8m\" (UniqueName: \"kubernetes.io/projected/3564149b-9897-4710-8c88-85e0a97263db-kube-api-access-dlp8m\") pod \"tuned-bsf6r\" (UID: \"3564149b-9897-4710-8c88-85e0a97263db\") " pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.105546 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.105491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5827l\" (UniqueName: \"kubernetes.io/projected/1c4776c4-4c10-4206-8766-1f369f0497b1-kube-api-access-5827l\") pod \"iptables-alerter-w65bw\" (UID: \"1c4776c4-4c10-4206-8766-1f369f0497b1\") " pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.106349 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.106323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gb8\" (UniqueName: \"kubernetes.io/projected/9b35cf4a-843a-4f93-863b-a58b691a0160-kube-api-access-59gb8\") pod \"node-resolver-hhpzm\" (UID: \"9b35cf4a-843a-4f93-863b-a58b691a0160\") " pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.106526 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.106505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bhkw\" (UniqueName: \"kubernetes.io/projected/b86400ed-a9f6-4343-93f4-2c96953811b7-kube-api-access-9bhkw\") pod \"multus-cdptc\" (UID: \"b86400ed-a9f6-4343-93f4-2c96953811b7\") " pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.106716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.106697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzqt\" (UniqueName: \"kubernetes.io/projected/9e9802d4-8b0b-42f7-8be7-779d96efe850-kube-api-access-4gzqt\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:18.106996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.106904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjbx\" (UniqueName: \"kubernetes.io/projected/e9baf65f-a159-4a7d-84b7-e5773e0aaad7-kube-api-access-4cjbx\") pod \"multus-additional-cni-plugins-l9rgh\" (UID: \"e9baf65f-a159-4a7d-84b7-e5773e0aaad7\") " pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.107078 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.107063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgj2s\" (UniqueName: \"kubernetes.io/projected/3b7c6098-17b4-46a2-b8ee-570590c8f867-kube-api-access-cgj2s\") pod \"node-ca-dhhk5\" (UID: \"3b7c6098-17b4-46a2-b8ee-570590c8f867\") " pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.107798 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.107783    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckf2h\" (UniqueName: \"kubernetes.io/projected/ab9c69b5-7de6-4eb9-8086-aa476024fc1f-kube-api-access-ckf2h\") pod \"aws-ebs-csi-driver-node-qj66w\" (UID: \"ab9c69b5-7de6-4eb9-8086-aa476024fc1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.239392 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.239303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w65bw"
Sep 09 21:08:18.241499 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.241480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:18.251369 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.251343    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4776c4_4c10_4206_8766_1f369f0497b1.slice/crio-97ee43f8af7223f4129c86bb1fc43072c4d07589e5ee2358be2560b7bcb7c171 WatchSource:0}: Error finding container 97ee43f8af7223f4129c86bb1fc43072c4d07589e5ee2358be2560b7bcb7c171: Status 404 returned error can't find the container with id 97ee43f8af7223f4129c86bb1fc43072c4d07589e5ee2358be2560b7bcb7c171
Sep 09 21:08:18.251944 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.251926    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2fbcf3_abe3_4ac1_8ac7_b72f8ba3c795.slice/crio-2e5c688a37dec31d460c08d53002b1ccee4bdc75541a15bf6fad514e1f27cde0 WatchSource:0}: Error finding container 2e5c688a37dec31d460c08d53002b1ccee4bdc75541a15bf6fad514e1f27cde0: Status 404 returned error can't find the container with id 2e5c688a37dec31d460c08d53002b1ccee4bdc75541a15bf6fad514e1f27cde0
Sep 09 21:08:18.265628 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.265596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:18.274747 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.274717    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0f37c8_6b62_4fcd_b3ce_1037223375ce.slice/crio-8c2c7a145c71e8c11d8f86cf0d4a997ecd9f2ff0a1898570a72e342187d30cfa WatchSource:0}: Error finding container 8c2c7a145c71e8c11d8f86cf0d4a997ecd9f2ff0a1898570a72e342187d30cfa: Status 404 returned error can't find the container with id 8c2c7a145c71e8c11d8f86cf0d4a997ecd9f2ff0a1898570a72e342187d30cfa
Sep 09 21:08:18.278699 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.278678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w"
Sep 09 21:08:18.286469 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.286446    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9c69b5_7de6_4eb9_8086_aa476024fc1f.slice/crio-0833aedcddf5993702209d5e77b5fd98069cb021a0e01cfbcbe25dab2bb400f6 WatchSource:0}: Error finding container 0833aedcddf5993702209d5e77b5fd98069cb021a0e01cfbcbe25dab2bb400f6: Status 404 returned error can't find the container with id 0833aedcddf5993702209d5e77b5fd98069cb021a0e01cfbcbe25dab2bb400f6
Sep 09 21:08:18.293786 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.293766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsf6r"
Sep 09 21:08:18.301871 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.301849    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3564149b_9897_4710_8c88_85e0a97263db.slice/crio-3a22a575f0c23226c9a9f90f7ed1efa94fa3088de34adfb2d3a905a2a9422a2c WatchSource:0}: Error finding container 3a22a575f0c23226c9a9f90f7ed1efa94fa3088de34adfb2d3a905a2a9422a2c: Status 404 returned error can't find the container with id 3a22a575f0c23226c9a9f90f7ed1efa94fa3088de34adfb2d3a905a2a9422a2c
Sep 09 21:08:18.309938 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.309907    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hhpzm"
Sep 09 21:08:18.318333 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.318183    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b35cf4a_843a_4f93_863b_a58b691a0160.slice/crio-e2138cfb66e8bb576bfb19e4427179a1136c0f6bb4b7b15d97b3db73e503620e WatchSource:0}: Error finding container e2138cfb66e8bb576bfb19e4427179a1136c0f6bb4b7b15d97b3db73e503620e: Status 404 returned error can't find the container with id e2138cfb66e8bb576bfb19e4427179a1136c0f6bb4b7b15d97b3db73e503620e
Sep 09 21:08:18.327431 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.327416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dhhk5"
Sep 09 21:08:18.335808 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.335786    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7c6098_17b4_46a2_b8ee_570590c8f867.slice/crio-aeaf80392b93ded6813f64b067e49dc857fd13991977261e142b2327def25420 WatchSource:0}: Error finding container aeaf80392b93ded6813f64b067e49dc857fd13991977261e142b2327def25420: Status 404 returned error can't find the container with id aeaf80392b93ded6813f64b067e49dc857fd13991977261e142b2327def25420
Sep 09 21:08:18.340732 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.340717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9rgh"
Sep 09 21:08:18.349060 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.349037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdptc"
Sep 09 21:08:18.349272 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.349250    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9baf65f_a159_4a7d_84b7_e5773e0aaad7.slice/crio-805df5cbb750c14cc661f1a324ff55826744077d81e1edd69b32080468c93145 WatchSource:0}: Error finding container 805df5cbb750c14cc661f1a324ff55826744077d81e1edd69b32080468c93145: Status 404 returned error can't find the container with id 805df5cbb750c14cc661f1a324ff55826744077d81e1edd69b32080468c93145
Sep 09 21:08:18.358965 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:18.358945    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86400ed_a9f6_4343_93f4_2c96953811b7.slice/crio-8413fb3a35fa97bb66f9194a01a2f1d43fa40ee0a5e854693c72790d621cc82e WatchSource:0}: Error finding container 8413fb3a35fa97bb66f9194a01a2f1d43fa40ee0a5e854693c72790d621cc82e: Status 404 returned error can't find the container with id 8413fb3a35fa97bb66f9194a01a2f1d43fa40ee0a5e854693c72790d621cc82e
Sep 09 21:08:18.363083 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.363067    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:08:18.598339 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.598244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:18.598339 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.598307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:18.598599 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.598434    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:18.598599 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.598487    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:19.598474402 +0000 UTC m=+3.074167375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:18.598824 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.598802    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:18.598981 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.598875    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:19.598856849 +0000 UTC m=+3.074549841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:18.699818 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.699720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:18.700010 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.699936    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:18.700010 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.699961    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:18.700010 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.699973    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:18.700183 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:18.700034    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:08:19.700014403 +0000 UTC m=+3.175707399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:18.943401 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.943294    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 21:03:17 +0000 UTC" deadline="2028-06-16 12:52:34.961944812 +0000 UTC"
Sep 09 21:08:18.943401 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:18.943340    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15495h44m16.018609551s"
Sep 09 21:08:19.011186 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.011139    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:08:19.027099 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.027067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:19.027312 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.027216    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:19.054116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.053998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal" event={"ID":"d5995e8255ba8e9ba7eb911beeb5d5b7","Type":"ContainerStarted","Data":"0e14860dee7a6dd63c72f517a49b016921ffe60307ce35d8ce689687d7fcb58a"}
Sep 09 21:08:19.072665 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.072562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal" event={"ID":"4392e07847543f3d7d91590de7915159","Type":"ContainerStarted","Data":"b0326d580724a7fe128b4944720b3702323b8a76764cbdbf4a4fc4ab3171852e"}
Sep 09 21:08:19.086207 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.086154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hhpzm" event={"ID":"9b35cf4a-843a-4f93-863b-a58b691a0160","Type":"ContainerStarted","Data":"e2138cfb66e8bb576bfb19e4427179a1136c0f6bb4b7b15d97b3db73e503620e"}
Sep 09 21:08:19.102276 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.102234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsf6r" event={"ID":"3564149b-9897-4710-8c88-85e0a97263db","Type":"ContainerStarted","Data":"3a22a575f0c23226c9a9f90f7ed1efa94fa3088de34adfb2d3a905a2a9422a2c"}
Sep 09 21:08:19.118843 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.118763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g29wp" event={"ID":"cc0f37c8-6b62-4fcd-b3ce-1037223375ce","Type":"ContainerStarted","Data":"8c2c7a145c71e8c11d8f86cf0d4a997ecd9f2ff0a1898570a72e342187d30cfa"}
Sep 09 21:08:19.140982 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.140928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"2e5c688a37dec31d460c08d53002b1ccee4bdc75541a15bf6fad514e1f27cde0"}
Sep 09 21:08:19.163777 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.163736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w65bw" event={"ID":"1c4776c4-4c10-4206-8766-1f369f0497b1","Type":"ContainerStarted","Data":"97ee43f8af7223f4129c86bb1fc43072c4d07589e5ee2358be2560b7bcb7c171"}
Sep 09 21:08:19.189846 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.189756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdptc" event={"ID":"b86400ed-a9f6-4343-93f4-2c96953811b7","Type":"ContainerStarted","Data":"8413fb3a35fa97bb66f9194a01a2f1d43fa40ee0a5e854693c72790d621cc82e"}
Sep 09 21:08:19.211098 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.211008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerStarted","Data":"805df5cbb750c14cc661f1a324ff55826744077d81e1edd69b32080468c93145"}
Sep 09 21:08:19.240048 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.239860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhhk5" event={"ID":"3b7c6098-17b4-46a2-b8ee-570590c8f867","Type":"ContainerStarted","Data":"aeaf80392b93ded6813f64b067e49dc857fd13991977261e142b2327def25420"}
Sep 09 21:08:19.259190 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.259136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w" event={"ID":"ab9c69b5-7de6-4eb9-8086-aa476024fc1f","Type":"ContainerStarted","Data":"0833aedcddf5993702209d5e77b5fd98069cb021a0e01cfbcbe25dab2bb400f6"}
Sep 09 21:08:19.607515 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.607478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:19.607669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.607558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:19.607730 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.607675    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:19.607730 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.607727    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:21.60771202 +0000 UTC m=+5.083404993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:19.608162 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.608142    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:19.608241 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.608201    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:21.608184701 +0000 UTC m=+5.083877679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:19.708523 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.708484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:19.708716 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.708700    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:19.708788 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.708723    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:19.708788 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.708735    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:19.708894 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:19.708795    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:08:21.70877715 +0000 UTC m=+5.184470127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:19.944931 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.944798    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 21:03:17 +0000 UTC" deadline="2028-04-13 09:42:09.178462322 +0000 UTC"
Sep 09 21:08:19.944931 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:19.944861    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13956h33m49.233605389s"
Sep 09 21:08:20.025135 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:20.025065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:20.025334 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:20.025201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:20.025634 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:20.025613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:20.025740 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:20.025718    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:20.635522 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:20.635270    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 21:08:21.027513 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:21.027472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:21.027985 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.027617    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:21.624189 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:21.624160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:21.624363 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:21.624220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:21.624363 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.624321    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:21.624492 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.624368    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:25.624355164 +0000 UTC m=+9.100048137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:21.624735 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.624714    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:21.624823 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.624773    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:25.624756672 +0000 UTC m=+9.100449651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:21.724612 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:21.724550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:21.724794 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.724718    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:21.724794 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.724745    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:21.724794 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.724757    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:21.724981 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:21.724822    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:08:25.724803445 +0000 UTC m=+9.200496441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:22.025787 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:22.025696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:22.025988 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:22.025846    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:22.026255 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:22.026224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:22.026372 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:22.026347    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:23.026971 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:23.026938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:23.027442 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:23.027067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:24.025487 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:24.025450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:24.025669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:24.025501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:24.025669 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:24.025598    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:24.025784 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:24.025740    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:25.025610 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:25.025426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:25.025610 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.025567    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:25.661846 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:25.661803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:25.662029 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:25.661869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:25.662029 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.662009    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:25.662029 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.662009    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:25.662200 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.662081    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:33.662062786 +0000 UTC m=+17.137755783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:25.662200 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.662101    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:33.66209106 +0000 UTC m=+17.137784040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:25.762670 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:25.762635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:25.762853 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.762819    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:25.762853 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.762842    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:25.762853 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.762855    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:25.763067 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:25.762935    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:08:33.762898247 +0000 UTC m=+17.238591233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:26.025345 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:26.025255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:26.025510 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:26.025255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:26.025510 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:26.025400    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:26.025510 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:26.025471    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:27.027619 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:27.027584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:27.028226 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:27.027811    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:28.025820 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:28.025739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:28.025982 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:28.025876    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:28.025982 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:28.025934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:28.026088 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:28.026056    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:29.025883 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:29.025841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:29.026384 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:29.026015    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:30.025733 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:30.025696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:30.025879 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:30.025707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:30.025879 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:30.025801    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:30.026283 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:30.025892    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:31.025210 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:31.025175    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:31.025402 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:31.025309    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:32.025140 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:32.025102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:32.025557 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:32.025108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:32.025557 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:32.025244    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:32.025557 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:32.025331    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:33.025652 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:33.025610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:33.026122 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.025744    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:33.732653 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:33.732610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:33.732906 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:33.732698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:33.732906 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.732777    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:33.732906 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.732805    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:33.732906 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.732861    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:49.732842709 +0000 UTC m=+33.208535687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:33.732906 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.732879    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:08:49.732868596 +0000 UTC m=+33.208561573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:33.833434 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:33.833399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:33.833609 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.833538    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:33.833609 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.833554    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:33.833609 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.833562    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:33.833742 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:33.833617    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:08:49.833603798 +0000 UTC m=+33.309296771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:34.025296 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:34.025215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:34.025452 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:34.025215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:34.025452 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:34.025340    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:34.025452 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:34.025391    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:35.025361 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:35.025310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:35.025848 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:35.025465    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:36.025742 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:36.025178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:36.025742 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:36.025344    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:36.025742 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:36.025388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:36.025742 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:36.025493    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:37.026026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:37.025991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:37.026512 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:37.026102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:38.025094 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.025050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:38.025094 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.025070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:38.025449 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:38.025267    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:38.025449 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:38.025333    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:38.309965 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.309360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdptc" event={"ID":"b86400ed-a9f6-4343-93f4-2c96953811b7","Type":"ContainerStarted","Data":"1b1a2e4b782ae6b491458755e08cbbeb073b564e52995581164843535ebacc20"}
Sep 09 21:08:38.311581 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.311553    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal" event={"ID":"4392e07847543f3d7d91590de7915159","Type":"ContainerStarted","Data":"5c4aa2d99c05f3b892fe16ebfe99fbcfe2f26a199bf4b26587443ead0bf4704e"}
Sep 09 21:08:38.313167 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.313140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsf6r" event={"ID":"3564149b-9897-4710-8c88-85e0a97263db","Type":"ContainerStarted","Data":"31096428046a11622c61fab8e21045843d67816d1158893a4eb9f66f150b700a"}
Sep 09 21:08:38.315700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.315418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"5883739c3b1eec539323761127518693392c66fa3e46d4989508dd43530ef6b0"}
Sep 09 21:08:38.315700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.315488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"d42ec6b182ae3753936d36acd63061f9f336246826174b866603e939dddb294a"}
Sep 09 21:08:38.315700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.315539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"65efd6e3e28d0bb58690b0f57705bf2300782b7e4b50b00e4d90144ee52b7f00"}
Sep 09 21:08:38.369151 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.368943    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cdptc" podStartSLOduration=1.710889637 podStartE2EDuration="21.368873784s" totalImagesPullingTime="19.657984147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:38.339991088 +0000 UTC m=+21.815684083" watchObservedRunningTime="2026-09-09 21:08:38.368873784 +0000 UTC m=+21.844566780"
Sep 09 21:08:38.370821 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.370788    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bsf6r" podStartSLOduration=1.82174944 podStartE2EDuration="21.370776642s" totalImagesPullingTime="19.549027202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:38.367894741 +0000 UTC m=+21.843587740" watchObservedRunningTime="2026-09-09 21:08:38.370776642 +0000 UTC m=+21.846469637"
Sep 09 21:08:38.391795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:38.391751    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-64.ec2.internal" podStartSLOduration=21.391733829 podStartE2EDuration="21.391733829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:38.391424804 +0000 UTC m=+21.867117812" watchObservedRunningTime="2026-09-09 21:08:38.391733829 +0000 UTC m=+21.867426824"
Sep 09 21:08:39.025357 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.025317    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:39.025524 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:39.025451    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:39.319096 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.319062    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9baf65f-a159-4a7d-84b7-e5773e0aaad7" containerID="0fae65a5adbe34f474af45d54e04626f39c31aaaba0a7d3b9dfb44968d24017a" exitCode=0
Sep 09 21:08:39.319704 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.319107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerDied","Data":"0fae65a5adbe34f474af45d54e04626f39c31aaaba0a7d3b9dfb44968d24017a"}
Sep 09 21:08:39.320699 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.320618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dhhk5" event={"ID":"3b7c6098-17b4-46a2-b8ee-570590c8f867","Type":"ContainerStarted","Data":"f457f61b6153c875dcb08a624484c5110865368320e9de7eda05990c664e5c7c"}
Sep 09 21:08:39.322155 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.322059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w" event={"ID":"ab9c69b5-7de6-4eb9-8086-aa476024fc1f","Type":"ContainerStarted","Data":"b69dd03cda3428daa00fe06e4a6f2949fac2f81073a2d05718b644ada9edb0d5"}
Sep 09 21:08:39.323553 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.323532    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5995e8255ba8e9ba7eb911beeb5d5b7" containerID="a532fcac2678da2b4763e1fbfcb6dfc73c57efbc7d52acd4cc8345d579888801" exitCode=0
Sep 09 21:08:39.323630 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.323600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal" event={"ID":"d5995e8255ba8e9ba7eb911beeb5d5b7","Type":"ContainerDied","Data":"a532fcac2678da2b4763e1fbfcb6dfc73c57efbc7d52acd4cc8345d579888801"}
Sep 09 21:08:39.325184 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.325160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hhpzm" event={"ID":"9b35cf4a-843a-4f93-863b-a58b691a0160","Type":"ContainerStarted","Data":"3e7477d149107f29f143bc81887b0833d681a79d40bf4696a9f7c958cf9a6238"}
Sep 09 21:08:39.326832 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.326812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g29wp" event={"ID":"cc0f37c8-6b62-4fcd-b3ce-1037223375ce","Type":"ContainerStarted","Data":"22cae92932c4dc78fb4bb99652bf45686c46f44c6522a99a6913e083d6528e58"}
Sep 09 21:08:39.329860 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.329834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"5edbd29343e65615a06e9b3d13dd160ac7066cecd06f78f1a393def196f9be6a"}
Sep 09 21:08:39.329965 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.329930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"50cd05f55e1565b148a630ec18bca05988636d11073f1b61486b33df44b109e6"}
Sep 09 21:08:39.330022 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.329979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"52a3b62d77dccc98295aba0e6d5399fa24500f171dcd7b6a13d90402145a17f2"}
Sep 09 21:08:39.334134 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.334089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w65bw" event={"ID":"1c4776c4-4c10-4206-8766-1f369f0497b1","Type":"ContainerStarted","Data":"9193f6a7d3ff9f1fb96d2a4169841343629112978b9d632cd21f5f3788dc3e61"}
Sep 09 21:08:39.387221 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.387158    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w65bw" podStartSLOduration=2.789878285 podStartE2EDuration="22.387144816s" totalImagesPullingTime="19.597266531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:39.38667024 +0000 UTC m=+22.862363234" watchObservedRunningTime="2026-09-09 21:08:39.387144816 +0000 UTC m=+22.862837810"
Sep 09 21:08:39.403886 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.403841    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dhhk5" podStartSLOduration=6.683233066 podStartE2EDuration="22.403824882s" totalImagesPullingTime="15.720591816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:39.403723641 +0000 UTC m=+22.879416633" watchObservedRunningTime="2026-09-09 21:08:39.403824882 +0000 UTC m=+22.879517873"
Sep 09 21:08:39.440131 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.440082    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g29wp" podStartSLOduration=2.865829257 podStartE2EDuration="22.44006471s" totalImagesPullingTime="19.574235453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:39.420609769 +0000 UTC m=+22.896302754" watchObservedRunningTime="2026-09-09 21:08:39.44006471 +0000 UTC m=+22.915757707"
Sep 09 21:08:39.440359 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.440337    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hhpzm" podStartSLOduration=2.909835982 podStartE2EDuration="22.440331435s" totalImagesPullingTime="19.530495453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:39.439815083 +0000 UTC m=+22.915508078" watchObservedRunningTime="2026-09-09 21:08:39.440331435 +0000 UTC m=+22.916024427"
Sep 09 21:08:39.622079 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.622048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:39.622710 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:39.622682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:40.002020 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.001749    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 21:08:40.024872 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.024843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:40.025047 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.024884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:40.025047 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:40.024992    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:40.031563 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:40.025072    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:40.338273 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.338189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w" event={"ID":"ab9c69b5-7de6-4eb9-8086-aa476024fc1f","Type":"ContainerStarted","Data":"eb48c9dd544913561fd426fb32bb82774fa879f90ae90b85e9fae8d28ef7228b"}
Sep 09 21:08:40.340397 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.340364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal" event={"ID":"d5995e8255ba8e9ba7eb911beeb5d5b7","Type":"ContainerStarted","Data":"24b5567eeb694ca231edada00eb3cb4783c623ccc143c0e4c68e58db215fd90e"}
Sep 09 21:08:40.340996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.340685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:40.341110 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.341055    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g29wp"
Sep 09 21:08:40.359759 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.359717    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-64.ec2.internal" podStartSLOduration=23.359702992 podStartE2EDuration="23.359702992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:40.359244391 +0000 UTC m=+23.834937385" watchObservedRunningTime="2026-09-09 21:08:40.359702992 +0000 UTC m=+23.835395987"
Sep 09 21:08:40.959562 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.959437    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T21:08:40.001900452Z","UUID":"5ca0e924-4aad-4859-a633-65f12464a021","Handler":null,"Name":"","Endpoint":""}
Sep 09 21:08:40.961412 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.961384    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 21:08:40.961548 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:40.961419    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 21:08:41.025961 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:41.025861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:41.026117 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:41.026027    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:41.347042 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:41.346951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"823988c648e6e8105094152e6c99d848e53868e421020c1e0be68c75f9c32023"}
Sep 09 21:08:42.025515 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:42.025479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:42.025515 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:42.025518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:42.025764 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:42.025592    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:42.025764 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:42.025703    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:42.351547 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:42.351452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w" event={"ID":"ab9c69b5-7de6-4eb9-8086-aa476024fc1f","Type":"ContainerStarted","Data":"2f4836646ec3d578b7e90df2ed610e408b1ec91bb313aa897d026b64c8bf0504"}
Sep 09 21:08:42.374649 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:42.374595    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qj66w" podStartSLOduration=2.947589954 podStartE2EDuration="25.374577699s" totalImagesPullingTime="22.426987745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:42.373847195 +0000 UTC m=+25.849540191" watchObservedRunningTime="2026-09-09 21:08:42.374577699 +0000 UTC m=+25.850270694"
Sep 09 21:08:43.025146 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:43.025111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:43.025338 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:43.025254    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:44.025606 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.025582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:44.025891 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.025622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:44.025891 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:44.025700    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:44.025891 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:44.025781    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:44.363362 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.363132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" event={"ID":"fa2fbcf3-abe3-4ac1-8ac7-b72f8ba3c795","Type":"ContainerStarted","Data":"e0a86017396988922ccd5c4d19a74dc4baf25906ecca05b2d21a44acf97c64d6"}
Sep 09 21:08:44.363691 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.363527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:44.365411 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.365378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerStarted","Data":"552aeed5789bc1296ec8fd9b82f23722ec6c5d98965f34c0c5c03dce344b8aa8"}
Sep 09 21:08:44.380974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.380943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:44.400116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:44.400063    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4" podStartSLOduration=7.768991178 podStartE2EDuration="27.400048434s" totalImagesPullingTime="19.631057256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:44.398431473 +0000 UTC m=+27.874124467" watchObservedRunningTime="2026-09-09 21:08:44.400048434 +0000 UTC m=+27.875741461"
Sep 09 21:08:45.025635 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.025604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:45.026061 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:45.025710    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:45.369867 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.369790    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9baf65f-a159-4a7d-84b7-e5773e0aaad7" containerID="552aeed5789bc1296ec8fd9b82f23722ec6c5d98965f34c0c5c03dce344b8aa8" exitCode=0
Sep 09 21:08:45.370030 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.369883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerDied","Data":"552aeed5789bc1296ec8fd9b82f23722ec6c5d98965f34c0c5c03dce344b8aa8"}
Sep 09 21:08:45.370377 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.370358    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:45.370491 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.370431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:45.387124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.387092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:08:45.926719 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.926686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwhf8"]
Sep 09 21:08:45.926896 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.926829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:45.926995 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:45.926972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:45.929419 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.929393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tdb4"]
Sep 09 21:08:45.929545 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.929491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:45.929611 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:45.929590    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:45.942640 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.942561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvlqx"]
Sep 09 21:08:45.942756 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:45.942680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:45.942811 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:45.942769    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:47.376528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:47.376309    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9baf65f-a159-4a7d-84b7-e5773e0aaad7" containerID="afeb0ec13217811e1af936acdbe93755e16c131cd02c83e352eb54651413e543" exitCode=0
Sep 09 21:08:47.376528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:47.376393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerDied","Data":"afeb0ec13217811e1af936acdbe93755e16c131cd02c83e352eb54651413e543"}
Sep 09 21:08:48.025757 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:48.025675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:48.025894 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:48.025678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:48.025894 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:48.025794    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:48.025894 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:48.025803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:48.025894 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:48.025876    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:48.026081 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:48.025969    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:49.384280 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:49.384249    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9baf65f-a159-4a7d-84b7-e5773e0aaad7" containerID="7c2c957b451fe56cbeee6372727d6a460f4734edb7529bf0b49f1406e61d0678" exitCode=0
Sep 09 21:08:49.384671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:49.384291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerDied","Data":"7c2c957b451fe56cbeee6372727d6a460f4734edb7529bf0b49f1406e61d0678"}
Sep 09 21:08:49.746607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:49.746507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:49.746607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:49.746578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:49.746804 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.746675    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:49.746804 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.746741    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:21.746728002 +0000 UTC m=+65.222420980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 21:08:49.746804 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.746676    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:49.746804 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.746776    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret podName:d1068620-d122-49bf-80fa-01755da20901 nodeName:}" failed. No retries permitted until 2026-09-09 21:09:21.746769392 +0000 UTC m=+65.222462364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret") pod "global-pull-secret-syncer-kwhf8" (UID: "d1068620-d122-49bf-80fa-01755da20901") : object "kube-system"/"original-pull-secret" not registered
Sep 09 21:08:49.847756 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:49.847721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:49.847927 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.847852    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 21:08:49.847927 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.847867    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 21:08:49.847927 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.847876    2580 projected.go:196] Error preparing data for projected volume kube-api-access-nm5fp for pod openshift-network-diagnostics/network-check-target-7tdb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:49.848022 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:49.847937    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp podName:8c061401-847a-43ed-b8f4-f517736addbe nodeName:}" failed. No retries permitted until 2026-09-09 21:09:21.847925113 +0000 UTC m=+65.323618099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nm5fp" (UniqueName: "kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp") pod "network-check-target-7tdb4" (UID: "8c061401-847a-43ed-b8f4-f517736addbe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 21:08:50.025855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.025770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:50.025855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.025805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:50.025855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.025818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:50.026125 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:50.025933    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:08:50.026125 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:50.026005    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tdb4" podUID="8c061401-847a-43ed-b8f4-f517736addbe"
Sep 09 21:08:50.026125 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:50.026093    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwhf8" podUID="d1068620-d122-49bf-80fa-01755da20901"
Sep 09 21:08:50.834118 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.834033    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-64.ec2.internal" event="NodeReady"
Sep 09 21:08:50.834589 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.834170    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 21:08:50.899256 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.899214    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6n25h"]
Sep 09 21:08:50.913461 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.913429    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6njgl"]
Sep 09 21:08:50.914883 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.914528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:50.918155 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.918132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rdjz\""
Sep 09 21:08:50.919935 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.919896    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 21:08:50.920108 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.919899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 21:08:50.924038 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.924018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6n25h"]
Sep 09 21:08:50.924128 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.924058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6njgl"]
Sep 09 21:08:50.924172 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.924137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:50.929196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.929171    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xc5lb\""
Sep 09 21:08:50.929328 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.929221    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 21:08:50.929328 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.929266    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 21:08:50.929569 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:50.929553    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 21:08:51.057547 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.057517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzvp\" (UniqueName: \"kubernetes.io/projected/f891665c-6986-421c-9bd8-3f482c2dbebf-kube-api-access-2hzvp\") pod \"ingress-canary-6njgl\" (UID: \"f891665c-6986-421c-9bd8-3f482c2dbebf\") " pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.057746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.057556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.057746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.057583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24873d71-47c5-4f54-8514-6a45b864864e-tmp-dir\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.057746 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.057689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f891665c-6986-421c-9bd8-3f482c2dbebf-cert\") pod \"ingress-canary-6njgl\" (UID: \"f891665c-6986-421c-9bd8-3f482c2dbebf\") " pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.057854 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.057774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jp4s\" (UniqueName: \"kubernetes.io/projected/24873d71-47c5-4f54-8514-6a45b864864e-kube-api-access-8jp4s\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.057854 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.057804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24873d71-47c5-4f54-8514-6a45b864864e-config-volume\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.158929 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.158827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f891665c-6986-421c-9bd8-3f482c2dbebf-cert\") pod \"ingress-canary-6njgl\" (UID: \"f891665c-6986-421c-9bd8-3f482c2dbebf\") " pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.158929 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.158906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jp4s\" (UniqueName: \"kubernetes.io/projected/24873d71-47c5-4f54-8514-6a45b864864e-kube-api-access-8jp4s\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.159225 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.158952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24873d71-47c5-4f54-8514-6a45b864864e-config-volume\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.159225 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.158996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzvp\" (UniqueName: \"kubernetes.io/projected/f891665c-6986-421c-9bd8-3f482c2dbebf-kube-api-access-2hzvp\") pod \"ingress-canary-6njgl\" (UID: \"f891665c-6986-421c-9bd8-3f482c2dbebf\") " pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.159225 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.159016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.159225 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.159038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24873d71-47c5-4f54-8514-6a45b864864e-tmp-dir\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.159225 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:51.159203    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:51.159461 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:51.159275    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:08:51.659255115 +0000 UTC m=+35.134948101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:51.159524 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.159464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24873d71-47c5-4f54-8514-6a45b864864e-tmp-dir\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.159635 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.159612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24873d71-47c5-4f54-8514-6a45b864864e-config-volume\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.164169 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.164148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f891665c-6986-421c-9bd8-3f482c2dbebf-cert\") pod \"ingress-canary-6njgl\" (UID: \"f891665c-6986-421c-9bd8-3f482c2dbebf\") " pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.169725 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.169691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzvp\" (UniqueName: \"kubernetes.io/projected/f891665c-6986-421c-9bd8-3f482c2dbebf-kube-api-access-2hzvp\") pod \"ingress-canary-6njgl\" (UID: \"f891665c-6986-421c-9bd8-3f482c2dbebf\") " pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.171237 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.171211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jp4s\" (UniqueName: \"kubernetes.io/projected/24873d71-47c5-4f54-8514-6a45b864864e-kube-api-access-8jp4s\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.236428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.236387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6njgl"
Sep 09 21:08:51.552428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.552187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6njgl"]
Sep 09 21:08:51.557255 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:08:51.557224    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf891665c_6986_421c_9bd8_3f482c2dbebf.slice/crio-ae99ef9f774bfac23685c7ffbd0aa6a3bc608065ee2a2066d40d5b6ce5bd6f13 WatchSource:0}: Error finding container ae99ef9f774bfac23685c7ffbd0aa6a3bc608065ee2a2066d40d5b6ce5bd6f13: Status 404 returned error can't find the container with id ae99ef9f774bfac23685c7ffbd0aa6a3bc608065ee2a2066d40d5b6ce5bd6f13
Sep 09 21:08:51.662955 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:51.662902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:51.663184 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:51.663078    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:51.663184 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:51.663156    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:08:52.663136479 +0000 UTC m=+36.138829469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:52.025558 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.025469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:08:52.025558 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.025527    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:08:52.026088 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.025471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:08:52.029466 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.029444    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 21:08:52.029466 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.029453    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 21:08:52.030490 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.030472    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 21:08:52.030957 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.030721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xv4rm\""
Sep 09 21:08:52.030957 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.030734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 21:08:52.030957 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.030739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdn8f\""
Sep 09 21:08:52.393956 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.393850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6njgl" event={"ID":"f891665c-6986-421c-9bd8-3f482c2dbebf","Type":"ContainerStarted","Data":"ae99ef9f774bfac23685c7ffbd0aa6a3bc608065ee2a2066d40d5b6ce5bd6f13"}
Sep 09 21:08:52.673219 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:52.673136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:52.673362 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:52.673290    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:52.673418 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:52.673375    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:08:54.673353393 +0000 UTC m=+38.149046369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:54.401651 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:54.401616    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9baf65f-a159-4a7d-84b7-e5773e0aaad7" containerID="da356b53494d0c6517d6f5a1aae0d84db9fe8aac8bca5a5943f07fca7b3f3bbe" exitCode=0
Sep 09 21:08:54.402381 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:54.401677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerDied","Data":"da356b53494d0c6517d6f5a1aae0d84db9fe8aac8bca5a5943f07fca7b3f3bbe"}
Sep 09 21:08:54.689934 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:54.689829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:54.690118 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:54.689993    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:54.690118 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:54.690073    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:08:58.690054837 +0000 UTC m=+42.165747811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:08:55.408158 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:55.408123    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9baf65f-a159-4a7d-84b7-e5773e0aaad7" containerID="9f95353481441d1fc8080130ce69cbc141cb74cf95fe55a8d104c5813c75b1e1" exitCode=0
Sep 09 21:08:55.408673 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:55.408209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerDied","Data":"9f95353481441d1fc8080130ce69cbc141cb74cf95fe55a8d104c5813c75b1e1"}
Sep 09 21:08:56.414040 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:56.414012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" event={"ID":"e9baf65f-a159-4a7d-84b7-e5773e0aaad7","Type":"ContainerStarted","Data":"b3d33f9bf7f31fc5d046abcdba7fbd98545c5bf10f19cb9e11caa112412997cc"}
Sep 09 21:08:56.439350 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:56.439297    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l9rgh" podStartSLOduration=7.494921041 podStartE2EDuration="39.43927806s" totalImagesPullingTime="31.944357019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:56.438587829 +0000 UTC m=+39.914280834" watchObservedRunningTime="2026-09-09 21:08:56.43927806 +0000 UTC m=+39.914971045"
Sep 09 21:08:57.418039 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:57.417994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6njgl" event={"ID":"f891665c-6986-421c-9bd8-3f482c2dbebf","Type":"ContainerStarted","Data":"c6812ad7536f64ce590a84a00160dc2e0aad775a580512d3c070e5955e221a78"}
Sep 09 21:08:57.435881 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:57.435831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6njgl" podStartSLOduration=2.636017757 podStartE2EDuration="7.435813668s" totalImagesPullingTime="4.799795911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:08:57.434520007 +0000 UTC m=+40.910213002" watchObservedRunningTime="2026-09-09 21:08:57.435813668 +0000 UTC m=+40.911506660"
Sep 09 21:08:58.719454 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:08:58.719415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:08:58.719828 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:58.719523    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:08:58.719828 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:08:58.719574    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:09:06.719561291 +0000 UTC m=+50.195254263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:09:06.775280 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:06.775220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:09:06.775701 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:06.775390    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:09:06.775701 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:06.775464    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:09:22.775448853 +0000 UTC m=+66.251141826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:09:17.388298 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:17.388261    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5xc4"
Sep 09 21:09:21.778743 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.778687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:09:21.779280 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.778772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:09:21.782739 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.782717    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 21:09:21.782858 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.782793    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 21:09:21.789516 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:21.789498    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:09:21.789609 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:21.789582    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:10:25.789561101 +0000 UTC m=+129.265254077 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : secret "metrics-daemon-secret" not found
Sep 09 21:09:21.792582 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.792558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1068620-d122-49bf-80fa-01755da20901-original-pull-secret\") pod \"global-pull-secret-syncer-kwhf8\" (UID: \"d1068620-d122-49bf-80fa-01755da20901\") " pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:09:21.879209 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.879161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:09:21.882843 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.882821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 21:09:21.892922 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.892896    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 21:09:21.902792 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:21.902766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5fp\" (UniqueName: \"kubernetes.io/projected/8c061401-847a-43ed-b8f4-f517736addbe-kube-api-access-nm5fp\") pod \"network-check-target-7tdb4\" (UID: \"8c061401-847a-43ed-b8f4-f517736addbe\") " pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:09:22.045595 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.045517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwhf8"
Sep 09 21:09:22.053951 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.053929    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xv4rm\""
Sep 09 21:09:22.059755 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.059730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:09:22.327295 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.327210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwhf8"]
Sep 09 21:09:22.330731 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:09:22.330709    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1068620_d122_49bf_80fa_01755da20901.slice/crio-726ab65620775d0a9053b64262ac033028516862bf15f2e1910ca2ccc056b878 WatchSource:0}: Error finding container 726ab65620775d0a9053b64262ac033028516862bf15f2e1910ca2ccc056b878: Status 404 returned error can't find the container with id 726ab65620775d0a9053b64262ac033028516862bf15f2e1910ca2ccc056b878
Sep 09 21:09:22.345900 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.345876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tdb4"]
Sep 09 21:09:22.351033 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:09:22.351011    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c061401_847a_43ed_b8f4_f517736addbe.slice/crio-69855a0d8167db3b444b83d7e446c7bcda9f9bdfcb640bae4e5620e444f69c2b WatchSource:0}: Error finding container 69855a0d8167db3b444b83d7e446c7bcda9f9bdfcb640bae4e5620e444f69c2b: Status 404 returned error can't find the container with id 69855a0d8167db3b444b83d7e446c7bcda9f9bdfcb640bae4e5620e444f69c2b
Sep 09 21:09:22.478454 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.478412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tdb4" event={"ID":"8c061401-847a-43ed-b8f4-f517736addbe","Type":"ContainerStarted","Data":"69855a0d8167db3b444b83d7e446c7bcda9f9bdfcb640bae4e5620e444f69c2b"}
Sep 09 21:09:22.479519 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.479498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwhf8" event={"ID":"d1068620-d122-49bf-80fa-01755da20901","Type":"ContainerStarted","Data":"726ab65620775d0a9053b64262ac033028516862bf15f2e1910ca2ccc056b878"}
Sep 09 21:09:22.786343 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:22.786301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:09:22.786904 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:22.786481    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:09:22.786904 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:22.786565    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:09:54.78654136 +0000 UTC m=+98.262234347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:09:27.495219 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:27.495122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tdb4" event={"ID":"8c061401-847a-43ed-b8f4-f517736addbe","Type":"ContainerStarted","Data":"c995ba5db94f91d4221018387681350bc2c2c303c0a4bac179e4d0bd5cbfe6c2"}
Sep 09 21:09:27.495618 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:27.495241    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:09:27.496748 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:27.496719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwhf8" event={"ID":"d1068620-d122-49bf-80fa-01755da20901","Type":"ContainerStarted","Data":"a26d0345779efb1dbe224abc738810cd359dc5c04dfa9553fbc72c7bfa8047db"}
Sep 09 21:09:27.511780 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:27.511736    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7tdb4" podStartSLOduration=65.718255222 podStartE2EDuration="1m10.511719877s" totalImagesPullingTime="4.793464655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:09:27.511071222 +0000 UTC m=+70.986764220" watchObservedRunningTime="2026-09-09 21:09:27.511719877 +0000 UTC m=+70.987412912"
Sep 09 21:09:27.526947 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:27.526885    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kwhf8" podStartSLOduration=65.713952974 podStartE2EDuration="1m10.52686914s" totalImagesPullingTime="4.812916166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:09:27.526504135 +0000 UTC m=+71.002197132" watchObservedRunningTime="2026-09-09 21:09:27.52686914 +0000 UTC m=+71.002562134"
Sep 09 21:09:54.796212 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:54.796171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:09:54.796704 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:54.796318    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:09:54.796704 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:09:54.796385    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:10:58.796369516 +0000 UTC m=+162.272062489 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:09:58.502175 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:09:58.502142    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7tdb4"
Sep 09 21:10:25.803493 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:10:25.803434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:10:25.804033 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:10:25.803604    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:10:25.804033 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:10:25.803678    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:27.803660744 +0000 UTC m=+251.279353717 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : secret "metrics-daemon-secret" not found
Sep 09 21:10:53.928019 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:10:53.927957    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6n25h" podUID="24873d71-47c5-4f54-8514-6a45b864864e"
Sep 09 21:10:54.704958 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:10:54.704928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6n25h"
Sep 09 21:10:55.038875 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:10:55.038835    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:10:58.825304 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:10:58.825246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:10:58.825824 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:10:58.825416    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 21:10:58.825824 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:10:58.825501    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls podName:24873d71-47c5-4f54-8514-6a45b864864e nodeName:}" failed. No retries permitted until 2026-09-09 21:13:00.825478511 +0000 UTC m=+284.301171486 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls") pod "dns-default-6n25h" (UID: "24873d71-47c5-4f54-8514-6a45b864864e") : secret "dns-default-metrics-tls" not found
Sep 09 21:11:07.026008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:11:07.025974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:12:27.820607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:27.820563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:12:27.821117 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:27.820689    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 21:12:27.821117 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:27.820740    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs podName:9e9802d4-8b0b-42f7-8be7-779d96efe850 nodeName:}" failed. No retries permitted until 2026-09-09 21:14:29.82072572 +0000 UTC m=+373.296418693 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs") pod "network-metrics-daemon-lvlqx" (UID: "9e9802d4-8b0b-42f7-8be7-779d96efe850") : secret "metrics-daemon-secret" not found
Sep 09 21:12:28.504793 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.504755    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"]
Sep 09 21:12:28.506706 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.506689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.510066 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.510046    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 21:12:28.510166 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.510043    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6vgwb\""
Sep 09 21:12:28.510577 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.510556    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 21:12:28.510706 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.510559    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 21:12:28.512125 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.512108    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 21:12:28.517880 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.517853    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-x4w78"]
Sep 09 21:12:28.519830 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.519816    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"]
Sep 09 21:12:28.519967 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.519952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.521543 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.521526    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-576cd65d99-l9wm6"]
Sep 09 21:12:28.521646 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.521632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"
Sep 09 21:12:28.523334 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.523316    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5589f67c66-9ztht"]
Sep 09 21:12:28.523438 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.523424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.524705 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.524687    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 09 21:12:28.525172 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.525153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.525291 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.525203    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 09 21:12:28.525382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.525156    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:12:28.526390 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.525974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 09 21:12:28.526390 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.526032    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mvcgn\""
Sep 09 21:12:28.526390 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.526061    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wt4ns\""
Sep 09 21:12:28.526793 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.526769    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 21:12:28.528221 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.528203    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 21:12:28.529724 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.529703    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 21:12:28.529946 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.529903    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 21:12:28.530032 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.529735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q5q4\""
Sep 09 21:12:28.530248 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530231    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 21:12:28.530324 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530278    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 21:12:28.530324 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530286    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 21:12:28.530324 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530298    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:12:28.530324 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530309    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 21:12:28.530820 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530277    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 21:12:28.530820 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.530716    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"]
Sep 09 21:12:28.531215 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.531189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6gzwl\""
Sep 09 21:12:28.533338 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.533319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 21:12:28.534723 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.534703    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"]
Sep 09 21:12:28.539486 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.539467    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 09 21:12:28.541626 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.541609    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 21:12:28.542807 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.542762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-x4w78"]
Sep 09 21:12:28.552935 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.552891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5589f67c66-9ztht"]
Sep 09 21:12:28.554745 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.554722    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576cd65d99-l9wm6"]
Sep 09 21:12:28.612287 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.612253    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"]
Sep 09 21:12:28.618856 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.618834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.622570 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.622548    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 21:12:28.622844 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.622553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jr4fc\""
Sep 09 21:12:28.623172 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.623147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:12:28.623672 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.623631    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"]
Sep 09 21:12:28.623836 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.623687    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 21:12:28.623836 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.623714    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 21:12:28.624756 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-bound-sa-token\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.624862 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8rjm\" (UniqueName: \"kubernetes.io/projected/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-kube-api-access-x8rjm\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.624862 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-image-registry-private-configuration\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625003 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-installation-pull-secrets\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625003 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-default-certificate\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.625003 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.625003 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.624989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9fc6dede-5a02-46ae-9061-ef114771785e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.625151 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80682f72-2926-44f1-bb38-2047d487fabc-trusted-ca\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.625151 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-trusted-ca\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625151 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.625151 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvgp\" (UniqueName: \"kubernetes.io/projected/9fc6dede-5a02-46ae-9061-ef114771785e-kube-api-access-6kvgp\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.625281 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.625281 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pv78\" (UniqueName: \"kubernetes.io/projected/80682f72-2926-44f1-bb38-2047d487fabc-kube-api-access-7pv78\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.625281 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-registry-certificates\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625414 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zhs2\" (UniqueName: \"kubernetes.io/projected/5ba6709f-09a7-4f65-95db-16d50859906e-kube-api-access-4zhs2\") pod \"volume-data-source-validator-695c895bd6-8fbfd\" (UID: \"5ba6709f-09a7-4f65-95db-16d50859906e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"
Sep 09 21:12:28.625414 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625414 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h75zl\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-kube-api-access-h75zl\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625414 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-stats-auth\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.625601 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80682f72-2926-44f1-bb38-2047d487fabc-config\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.625601 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80682f72-2926-44f1-bb38-2047d487fabc-serving-cert\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.625601 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fab6916-acad-468b-91ce-213e491d68b8-ca-trust-extracted\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.625963 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.625944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"]
Sep 09 21:12:28.626072 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.626010    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:28.654365 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.654342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 21:12:28.685034 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.685005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"]
Sep 09 21:12:28.694491 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.694469    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 21:12:28.698277 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.698259    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:12:28.703520 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.703506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hqqfs\""
Sep 09 21:12:28.726306 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pv78\" (UniqueName: \"kubernetes.io/projected/80682f72-2926-44f1-bb38-2047d487fabc-kube-api-access-7pv78\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.726379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-serving-cert\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.726379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:28.726379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-registry-certificates\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h75zl\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-kube-api-access-h75zl\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zhs2\" (UniqueName: \"kubernetes.io/projected/5ba6709f-09a7-4f65-95db-16d50859906e-kube-api-access-4zhs2\") pod \"volume-data-source-validator-695c895bd6-8fbfd\" (UID: \"5ba6709f-09a7-4f65-95db-16d50859906e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80682f72-2926-44f1-bb38-2047d487fabc-config\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fab6916-acad-468b-91ce-213e491d68b8-ca-trust-extracted\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2b9n\" (UniqueName: \"kubernetes.io/projected/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-kube-api-access-t2b9n\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.726528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-default-certificate\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.726535    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.726555    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-576cd65d99-l9wm6: secret "image-registry-tls" not found
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zgfr\" (UniqueName: \"kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8rjm\" (UniqueName: \"kubernetes.io/projected/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-kube-api-access-x8rjm\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9fc6dede-5a02-46ae-9061-ef114771785e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80682f72-2926-44f1-bb38-2047d487fabc-trusted-ca\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-trusted-ca\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-stats-auth\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-installation-pull-secrets\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-config\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.726780    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls podName:8fab6916-acad-468b-91ce-213e491d68b8 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:29.22674581 +0000 UTC m=+252.702438790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls") pod "image-registry-576cd65d99-l9wm6" (UID: "8fab6916-acad-468b-91ce-213e491d68b8") : secret "image-registry-tls" not found
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80682f72-2926-44f1-bb38-2047d487fabc-serving-cert\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.726999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.726991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-image-registry-private-configuration\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-bound-sa-token\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvgp\" (UniqueName: \"kubernetes.io/projected/9fc6dede-5a02-46ae-9061-ef114771785e-kube-api-access-6kvgp\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-registry-certificates\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.727334    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.727445    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:29.227428077 +0000 UTC m=+252.703121054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : secret "router-metrics-certs-default" not found
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fab6916-acad-468b-91ce-213e491d68b8-ca-trust-extracted\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.727566    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.727613    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls podName:9fc6dede-5a02-46ae-9061-ef114771785e nodeName:}" failed. No retries permitted until 2026-09-09 21:12:29.227599421 +0000 UTC m=+252.703292394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jsrhv" (UID: "9fc6dede-5a02-46ae-9061-ef114771785e") : secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:28.727671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9fc6dede-5a02-46ae-9061-ef114771785e-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.728267 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80682f72-2926-44f1-bb38-2047d487fabc-trusted-ca\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.728267 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.727732    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:29.227716643 +0000 UTC m=+252.703409635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : configmap references non-existent config key: service-ca.crt
Sep 09 21:12:28.728267 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.727791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-trusted-ca\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.728267 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.728120    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80682f72-2926-44f1-bb38-2047d487fabc-config\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.730086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.730063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-default-certificate\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.730162 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.730087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-image-registry-private-configuration\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.730162 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.730063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-stats-auth\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.730162 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.730154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-installation-pull-secrets\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.730298 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.730282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80682f72-2926-44f1-bb38-2047d487fabc-serving-cert\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.754354 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.754275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-bound-sa-token\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.754788 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.754762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pv78\" (UniqueName: \"kubernetes.io/projected/80682f72-2926-44f1-bb38-2047d487fabc-kube-api-access-7pv78\") pod \"console-operator-85b454874b-x4w78\" (UID: \"80682f72-2926-44f1-bb38-2047d487fabc\") " pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.755838 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.755788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h75zl\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-kube-api-access-h75zl\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:28.756109 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.756091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvgp\" (UniqueName: \"kubernetes.io/projected/9fc6dede-5a02-46ae-9061-ef114771785e-kube-api-access-6kvgp\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:28.756600 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.756580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8rjm\" (UniqueName: \"kubernetes.io/projected/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-kube-api-access-x8rjm\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:28.757342 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.757324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zhs2\" (UniqueName: \"kubernetes.io/projected/5ba6709f-09a7-4f65-95db-16d50859906e-kube-api-access-4zhs2\") pod \"volume-data-source-validator-695c895bd6-8fbfd\" (UID: \"5ba6709f-09a7-4f65-95db-16d50859906e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"
Sep 09 21:12:28.827784 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.827743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-serving-cert\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.827784 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.827787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:28.828350 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.827938    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 21:12:28.828350 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.827972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2b9n\" (UniqueName: \"kubernetes.io/projected/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-kube-api-access-t2b9n\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.828350 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:28.828001    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:29.32798411 +0000 UTC m=+252.803677090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : secret "samples-operator-tls" not found
Sep 09 21:12:28.828350 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.828035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zgfr\" (UniqueName: \"kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:28.828350 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.828082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-config\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.828680 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.828659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-config\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.829991 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.829973    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:28.830096 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.830079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-serving-cert\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.837519 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.837491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2b9n\" (UniqueName: \"kubernetes.io/projected/2154ecdb-a3d4-495e-b2f2-6a5723c7376e-kube-api-access-t2b9n\") pod \"service-ca-operator-859f94c4b-gbw4s\" (UID: \"2154ecdb-a3d4-495e-b2f2-6a5723c7376e\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:28.837603 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.837570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zgfr\" (UniqueName: \"kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:28.839283 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.839268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"
Sep 09 21:12:28.928689 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:28.928661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"
Sep 09 21:12:29.102723 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.102691    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-x4w78"]
Sep 09 21:12:29.105193 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:12:29.105167    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80682f72_2926_44f1_bb38_2047d487fabc.slice/crio-cc178e781d0637e054bb65240b4dcffbd18bbaab85376d9bc448d4981439043d WatchSource:0}: Error finding container cc178e781d0637e054bb65240b4dcffbd18bbaab85376d9bc448d4981439043d: Status 404 returned error can't find the container with id cc178e781d0637e054bb65240b4dcffbd18bbaab85376d9bc448d4981439043d
Sep 09 21:12:29.119510 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.119485    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd"]
Sep 09 21:12:29.122159 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:12:29.122134    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba6709f_09a7_4f65_95db_16d50859906e.slice/crio-66bc0a554a04edee5dd7ee86c27fa0e511c57d111187d1be80d0edd359e5e62d WatchSource:0}: Error finding container 66bc0a554a04edee5dd7ee86c27fa0e511c57d111187d1be80d0edd359e5e62d: Status 404 returned error can't find the container with id 66bc0a554a04edee5dd7ee86c27fa0e511c57d111187d1be80d0edd359e5e62d
Sep 09 21:12:29.194327 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.194292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s"]
Sep 09 21:12:29.197116 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:12:29.197084    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2154ecdb_a3d4_495e_b2f2_6a5723c7376e.slice/crio-c53187d343a9568bee8285a884da5c7557cb24eb84f79d6d63bdfa1f27524fc8 WatchSource:0}: Error finding container c53187d343a9568bee8285a884da5c7557cb24eb84f79d6d63bdfa1f27524fc8: Status 404 returned error can't find the container with id c53187d343a9568bee8285a884da5c7557cb24eb84f79d6d63bdfa1f27524fc8
Sep 09 21:12:29.230144 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.230116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:29.230289 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.230155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:29.230289 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230256    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 21:12:29.230394 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.230289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:29.230394 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230304    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:30.230280797 +0000 UTC m=+253.705973792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : configmap references non-existent config key: service-ca.crt
Sep 09 21:12:29.230394 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230367    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:30.230343049 +0000 UTC m=+253.706036021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : secret "router-metrics-certs-default" not found
Sep 09 21:12:29.230394 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230371    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:12:29.230394 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230384    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-576cd65d99-l9wm6: secret "image-registry-tls" not found
Sep 09 21:12:29.230632 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230424    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls podName:8fab6916-acad-468b-91ce-213e491d68b8 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:30.230412192 +0000 UTC m=+253.706105165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls") pod "image-registry-576cd65d99-l9wm6" (UID: "8fab6916-acad-468b-91ce-213e491d68b8") : secret "image-registry-tls" not found
Sep 09 21:12:29.230632 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.230456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:29.230632 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230527    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:29.230632 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.230555    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls podName:9fc6dede-5a02-46ae-9061-ef114771785e nodeName:}" failed. No retries permitted until 2026-09-09 21:12:30.230548223 +0000 UTC m=+253.706241195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jsrhv" (UID: "9fc6dede-5a02-46ae-9061-ef114771785e") : secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:29.331155 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.331114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:29.331339 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.331261    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 21:12:29.331339 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:29.331326    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:30.331309416 +0000 UTC m=+253.807002393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : secret "samples-operator-tls" not found
Sep 09 21:12:29.936465 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.936387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s" event={"ID":"2154ecdb-a3d4-495e-b2f2-6a5723c7376e","Type":"ContainerStarted","Data":"c53187d343a9568bee8285a884da5c7557cb24eb84f79d6d63bdfa1f27524fc8"}
Sep 09 21:12:29.938065 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.938025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-x4w78" event={"ID":"80682f72-2926-44f1-bb38-2047d487fabc","Type":"ContainerStarted","Data":"cc178e781d0637e054bb65240b4dcffbd18bbaab85376d9bc448d4981439043d"}
Sep 09 21:12:29.939429 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:29.939388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd" event={"ID":"5ba6709f-09a7-4f65-95db-16d50859906e","Type":"ContainerStarted","Data":"66bc0a554a04edee5dd7ee86c27fa0e511c57d111187d1be80d0edd359e5e62d"}
Sep 09 21:12:30.239790 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.239760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:30.239950 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.239810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:30.239950 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.239847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:30.240057 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.239978    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 21:12:30.240057 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.239986    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:30.240057 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.240012    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:32.239992009 +0000 UTC m=+255.715685001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : configmap references non-existent config key: service-ca.crt
Sep 09 21:12:30.240057 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.240039    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:32.240029796 +0000 UTC m=+255.715722769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : secret "router-metrics-certs-default" not found
Sep 09 21:12:30.240196 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.240071    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls podName:9fc6dede-5a02-46ae-9061-ef114771785e nodeName:}" failed. No retries permitted until 2026-09-09 21:12:32.240049817 +0000 UTC m=+255.715742804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jsrhv" (UID: "9fc6dede-5a02-46ae-9061-ef114771785e") : secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:30.240196 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.240115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:30.240196 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.240170    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:12:30.240196 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.240181    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-576cd65d99-l9wm6: secret "image-registry-tls" not found
Sep 09 21:12:30.240352 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.240213    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls podName:8fab6916-acad-468b-91ce-213e491d68b8 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:32.240202973 +0000 UTC m=+255.715895965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls") pod "image-registry-576cd65d99-l9wm6" (UID: "8fab6916-acad-468b-91ce-213e491d68b8") : secret "image-registry-tls" not found
Sep 09 21:12:30.341056 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.341011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:30.341242 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.341177    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 21:12:30.341306 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:30.341256    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:32.341236593 +0000 UTC m=+255.816929569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : secret "samples-operator-tls" not found
Sep 09 21:12:30.944482 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.944433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd" event={"ID":"5ba6709f-09a7-4f65-95db-16d50859906e","Type":"ContainerStarted","Data":"e054a2672e929acdcc9e8413bc896e5d2d0b303fda391d5f8a5e87d3ce92c229"}
Sep 09 21:12:30.961747 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:30.961681    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-8fbfd" podStartSLOduration=1.876720282 podStartE2EDuration="2.961660999s" totalImagesPullingTime="1.084940717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:30.961101196 +0000 UTC m=+254.436794191" watchObservedRunningTime="2026-09-09 21:12:30.961660999 +0000 UTC m=+254.437353993"
Sep 09 21:12:31.950177 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:31.950087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s" event={"ID":"2154ecdb-a3d4-495e-b2f2-6a5723c7376e","Type":"ContainerStarted","Data":"5ba46cc72f321e85d4a3124c4b995b4f20a5678b2a7a75deed5de37a62e5d89c"}
Sep 09 21:12:31.951743 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:31.951721    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/0.log"
Sep 09 21:12:31.951868 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:31.951758    2580 generic.go:356] "Generic (PLEG): container finished" podID="80682f72-2926-44f1-bb38-2047d487fabc" containerID="8b24c272fab51d82ba1c1fce875f754b043696ba575ada48a9c3b02292ee8382" exitCode=255
Sep 09 21:12:31.951868 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:31.951790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-x4w78" event={"ID":"80682f72-2926-44f1-bb38-2047d487fabc","Type":"ContainerDied","Data":"8b24c272fab51d82ba1c1fce875f754b043696ba575ada48a9c3b02292ee8382"}
Sep 09 21:12:31.952073 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:31.952058    2580 scope.go:117] "RemoveContainer" containerID="8b24c272fab51d82ba1c1fce875f754b043696ba575ada48a9c3b02292ee8382"
Sep 09 21:12:31.968359 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:31.968307    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s" podStartSLOduration=1.600682763 podStartE2EDuration="3.968288825s" totalImagesPullingTime="2.367606062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:31.968069866 +0000 UTC m=+255.443762860" watchObservedRunningTime="2026-09-09 21:12:31.968288825 +0000 UTC m=+255.443981821"
Sep 09 21:12:32.261062 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.260970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:32.261062 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.261031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.261079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.261105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261146    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261193    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261210    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-576cd65d99-l9wm6: secret "image-registry-tls" not found
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261214    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:32.261269 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261221    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.261206125 +0000 UTC m=+259.736899115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : configmap references non-existent config key: service-ca.crt
Sep 09 21:12:32.261637 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261281    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.261262994 +0000 UTC m=+259.736955975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : secret "router-metrics-certs-default" not found
Sep 09 21:12:32.261637 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261296    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls podName:8fab6916-acad-468b-91ce-213e491d68b8 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.261287032 +0000 UTC m=+259.736980008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls") pod "image-registry-576cd65d99-l9wm6" (UID: "8fab6916-acad-468b-91ce-213e491d68b8") : secret "image-registry-tls" not found
Sep 09 21:12:32.261637 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.261313    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls podName:9fc6dede-5a02-46ae-9061-ef114771785e nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.261301684 +0000 UTC m=+259.736994665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jsrhv" (UID: "9fc6dede-5a02-46ae-9061-ef114771785e") : secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:32.361757 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.361723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:32.361904 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.361843    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 21:12:32.361904 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.361903    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.361887771 +0000 UTC m=+259.837580760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : secret "samples-operator-tls" not found
Sep 09 21:12:32.529402 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.529364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pqqd2"]
Sep 09 21:12:32.531774 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.531755    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.535144 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.535123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 21:12:32.535285 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.535145    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 21:12:32.535557 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.535542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 21:12:32.535826 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.535811    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hr85\""
Sep 09 21:12:32.536488 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.536475    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 21:12:32.547293 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.547273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqqd2"]
Sep 09 21:12:32.563287 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.563265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-crio-socket\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.563428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.563296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.563428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.563343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.563428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.563386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stsc6\" (UniqueName: \"kubernetes.io/projected/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-api-access-stsc6\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.563578 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.563439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-data-volume\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.664723 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.664686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.664741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stsc6\" (UniqueName: \"kubernetes.io/projected/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-api-access-stsc6\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.664780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-data-volume\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.664796    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.664843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-crio-socket\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.664860    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:33.164838851 +0000 UTC m=+256.640531828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : configmap "kube-rbac-proxy" not found
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.664897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.664948 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.664903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-crio-socket\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.665312 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.665048    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:32.665312 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.665102    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:33.16508734 +0000 UTC m=+256.640780314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:32.665312 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.665194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-data-volume\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.674158 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.674137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stsc6\" (UniqueName: \"kubernetes.io/projected/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-api-access-stsc6\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:32.956941 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.956855    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/1.log"
Sep 09 21:12:32.957356 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.957330    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/0.log"
Sep 09 21:12:32.957425 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.957376    2580 generic.go:356] "Generic (PLEG): container finished" podID="80682f72-2926-44f1-bb38-2047d487fabc" containerID="4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa" exitCode=255
Sep 09 21:12:32.957504 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.957476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-x4w78" event={"ID":"80682f72-2926-44f1-bb38-2047d487fabc","Type":"ContainerDied","Data":"4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa"}
Sep 09 21:12:32.957574 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.957558    2580 scope.go:117] "RemoveContainer" containerID="8b24c272fab51d82ba1c1fce875f754b043696ba575ada48a9c3b02292ee8382"
Sep 09 21:12:32.957726 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:32.957699    2580 scope.go:117] "RemoveContainer" containerID="4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa"
Sep 09 21:12:32.957951 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:32.957903    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-x4w78_openshift-console-operator(80682f72-2926-44f1-bb38-2047d487fabc)\"" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podUID="80682f72-2926-44f1-bb38-2047d487fabc"
Sep 09 21:12:33.169851 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:33.169807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:33.170127 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:33.169875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:33.170127 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:33.169986    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:33.170127 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:33.170005    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 21:12:33.170127 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:33.170069    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:34.170051369 +0000 UTC m=+257.645744346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:33.170127 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:33.170084    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:34.1700781 +0000 UTC m=+257.645771073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : configmap "kube-rbac-proxy" not found
Sep 09 21:12:33.965370 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:33.965342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/1.log"
Sep 09 21:12:33.965733 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:33.965706    2580 scope.go:117] "RemoveContainer" containerID="4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa"
Sep 09 21:12:33.965908 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:33.965886    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-x4w78_openshift-console-operator(80682f72-2926-44f1-bb38-2047d487fabc)\"" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podUID="80682f72-2926-44f1-bb38-2047d487fabc"
Sep 09 21:12:34.179381 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:34.179318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:34.179381 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:34.179395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:34.179626 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:34.179491    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:34.179626 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:34.179558    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:36.179542842 +0000 UTC m=+259.655235815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:34.179965 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:34.179949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:34.459886 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:34.459858    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hhpzm_9b35cf4a-843a-4f93-863b-a58b691a0160/dns-node-resolver/0.log"
Sep 09 21:12:35.459996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.459968    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhhk5_3b7c6098-17b4-46a2-b8ee-570590c8f867/node-ca/0.log"
Sep 09 21:12:35.742935 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.742850    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-d8w6m"]
Sep 09 21:12:35.747091 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.747071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.749994 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.749973    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 21:12:35.750096 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.749971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 21:12:35.751298 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.751276    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 21:12:35.751405 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.751280    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2j84s\""
Sep 09 21:12:35.751405 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.751283    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 21:12:35.754316 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.754284    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-d8w6m"]
Sep 09 21:12:35.794079 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.794045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzdr6\" (UniqueName: \"kubernetes.io/projected/1b64f24c-4bff-49e5-87d8-3c42e47985d1-kube-api-access-wzdr6\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.794222 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.794205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1b64f24c-4bff-49e5-87d8-3c42e47985d1-signing-key\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.794266 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.794242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1b64f24c-4bff-49e5-87d8-3c42e47985d1-signing-cabundle\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.895627 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.895590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1b64f24c-4bff-49e5-87d8-3c42e47985d1-signing-key\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.895812 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.895638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1b64f24c-4bff-49e5-87d8-3c42e47985d1-signing-cabundle\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.895812 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.895680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzdr6\" (UniqueName: \"kubernetes.io/projected/1b64f24c-4bff-49e5-87d8-3c42e47985d1-kube-api-access-wzdr6\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.896345 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.896323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1b64f24c-4bff-49e5-87d8-3c42e47985d1-signing-cabundle\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.898277 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.898256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1b64f24c-4bff-49e5-87d8-3c42e47985d1-signing-key\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:35.904561 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:35.904536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzdr6\" (UniqueName: \"kubernetes.io/projected/1b64f24c-4bff-49e5-87d8-3c42e47985d1-kube-api-access-wzdr6\") pod \"service-ca-75d99c484-d8w6m\" (UID: \"1b64f24c-4bff-49e5-87d8-3c42e47985d1\") " pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:36.056569 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.056528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-d8w6m"
Sep 09 21:12:36.198947 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.198891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:36.199110 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.199056    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:36.199155 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.199123    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:40.199107521 +0000 UTC m=+263.674800493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:36.259068 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.259040    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6njgl_f891665c-6986-421c-9bd8-3f482c2dbebf/serve-healthcheck-canary/0.log"
Sep 09 21:12:36.300316 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.300278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:36.300443 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.300363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:36.300443 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.300399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:36.300443 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.300427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:36.300542 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300440    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 21:12:36.300542 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300460    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-576cd65d99-l9wm6: secret "image-registry-tls" not found
Sep 09 21:12:36.300542 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300499    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:36.300542 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300522    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 21:12:36.300542 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300529    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls podName:8fab6916-acad-468b-91ce-213e491d68b8 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.300511147 +0000 UTC m=+267.776204138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls") pod "image-registry-576cd65d99-l9wm6" (UID: "8fab6916-acad-468b-91ce-213e491d68b8") : secret "image-registry-tls" not found
Sep 09 21:12:36.300694 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300559    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.300537891 +0000 UTC m=+267.776230886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : configmap references non-existent config key: service-ca.crt
Sep 09 21:12:36.300694 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300587    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls podName:9fc6dede-5a02-46ae-9061-ef114771785e nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.300577708 +0000 UTC m=+267.776270680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jsrhv" (UID: "9fc6dede-5a02-46ae-9061-ef114771785e") : secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:36.300694 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.300601    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.300592869 +0000 UTC m=+267.776285876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : secret "router-metrics-certs-default" not found
Sep 09 21:12:36.329596 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.329528    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-d8w6m"]
Sep 09 21:12:36.332903 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:12:36.332872    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b64f24c_4bff_49e5_87d8_3c42e47985d1.slice/crio-eda058539b1d00a92cb717cc76de625fe074318217661c32dafe5d3b923effb7 WatchSource:0}: Error finding container eda058539b1d00a92cb717cc76de625fe074318217661c32dafe5d3b923effb7: Status 404 returned error can't find the container with id eda058539b1d00a92cb717cc76de625fe074318217661c32dafe5d3b923effb7
Sep 09 21:12:36.401674 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.401647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:36.401821 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.401808    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 21:12:36.401873 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:36.401864    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:44.401847179 +0000 UTC m=+267.877540154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : secret "samples-operator-tls" not found
Sep 09 21:12:36.976619 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.976582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-d8w6m" event={"ID":"1b64f24c-4bff-49e5-87d8-3c42e47985d1","Type":"ContainerStarted","Data":"b537ea74c55bc035c13433d2631df4e6e48c04b7005cd1790e53adf19571ef9a"}
Sep 09 21:12:36.976999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.976632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-d8w6m" event={"ID":"1b64f24c-4bff-49e5-87d8-3c42e47985d1","Type":"ContainerStarted","Data":"eda058539b1d00a92cb717cc76de625fe074318217661c32dafe5d3b923effb7"}
Sep 09 21:12:36.996224 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:36.996174    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-d8w6m" podStartSLOduration=1.996158781 podStartE2EDuration="1.996158781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:36.995261917 +0000 UTC m=+260.470954913" watchObservedRunningTime="2026-09-09 21:12:36.996158781 +0000 UTC m=+260.471851775"
Sep 09 21:12:38.830875 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:38.830785    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:38.830875 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:38.830859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:38.831310 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:38.831296    2580 scope.go:117] "RemoveContainer" containerID="4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa"
Sep 09 21:12:38.831501 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:38.831479    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-x4w78_openshift-console-operator(80682f72-2926-44f1-bb38-2047d487fabc)\"" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podUID="80682f72-2926-44f1-bb38-2047d487fabc"
Sep 09 21:12:40.235426 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:40.235388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:40.235822 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:40.235497    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:40.235822 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:40.235552    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls podName:82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396 nodeName:}" failed. No retries permitted until 2026-09-09 21:12:48.235537505 +0000 UTC m=+271.711230477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqqd2" (UID: "82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396") : secret "insights-runtime-extractor-tls" not found
Sep 09 21:12:44.376855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.376817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:12:44.377303 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.376874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:44.377303 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.376941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:44.377303 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:44.376998    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:44.377303 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.377012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:44.377303 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:44.377066    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle podName:3c915d66-6764-4ea7-8ffe-c4a5f10ae579 nodeName:}" failed. No retries permitted until 2026-09-09 21:13:00.377042465 +0000 UTC m=+283.852735457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle") pod "router-default-5589f67c66-9ztht" (UID: "3c915d66-6764-4ea7-8ffe-c4a5f10ae579") : configmap references non-existent config key: service-ca.crt
Sep 09 21:12:44.377303 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:44.377097    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls podName:9fc6dede-5a02-46ae-9061-ef114771785e nodeName:}" failed. No retries permitted until 2026-09-09 21:13:00.377086201 +0000 UTC m=+283.852779175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jsrhv" (UID: "9fc6dede-5a02-46ae-9061-ef114771785e") : secret "cluster-monitoring-operator-tls" not found
Sep 09 21:12:44.379869 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.379842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-metrics-certs\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:12:44.380004 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.379962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"image-registry-576cd65d99-l9wm6\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") " pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:44.445195 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.445155    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:44.478093 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.478059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:44.480696 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.480668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rk9p6\" (UID: \"71fcf886-ba5f-4f01-aa86-46b20c46ddf5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:44.534809 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.534778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"
Sep 09 21:12:44.724498 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.724418    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576cd65d99-l9wm6"]
Sep 09 21:12:44.728022 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:12:44.727982    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fab6916_acad_468b_91ce_213e491d68b8.slice/crio-c7b0d204230d9f7967c3aa33a47903f43a191d17abd672ceaa8391e3ea29b3c0 WatchSource:0}: Error finding container c7b0d204230d9f7967c3aa33a47903f43a191d17abd672ceaa8391e3ea29b3c0: Status 404 returned error can't find the container with id c7b0d204230d9f7967c3aa33a47903f43a191d17abd672ceaa8391e3ea29b3c0
Sep 09 21:12:44.805714 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:44.805677    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6"]
Sep 09 21:12:45.002237 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:45.002150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6" event={"ID":"71fcf886-ba5f-4f01-aa86-46b20c46ddf5","Type":"ContainerStarted","Data":"cc33f5fb7abc3f487a7bed1f6c014bd3a4886f969886a8ddc14e620cbbf3cfac"}
Sep 09 21:12:45.009248 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:45.009213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"0e447208697adc90f66376899c24d2f92ff00190243a415de52af125b10eee2e"}
Sep 09 21:12:45.009430 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:45.009301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"c7b0d204230d9f7967c3aa33a47903f43a191d17abd672ceaa8391e3ea29b3c0"}
Sep 09 21:12:45.009430 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:45.009354    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:12:45.034681 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:45.034618    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podStartSLOduration=17.034598023 podStartE2EDuration="17.034598023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:45.03389602 +0000 UTC m=+268.509589016" watchObservedRunningTime="2026-09-09 21:12:45.034598023 +0000 UTC m=+268.510291020"
Sep 09 21:12:47.016854 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:47.016822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6" event={"ID":"71fcf886-ba5f-4f01-aa86-46b20c46ddf5","Type":"ContainerStarted","Data":"9fc46c4bd4baff69b168ab9fd7052645c28600b0bd86fa2295eef0be78d57c8e"}
Sep 09 21:12:47.017254 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:47.016882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6" event={"ID":"71fcf886-ba5f-4f01-aa86-46b20c46ddf5","Type":"ContainerStarted","Data":"05c5b8f477ea3925da581e5bc9c0eed3730835bd73c83c3179b38ae69fcea3ed"}
Sep 09 21:12:47.037000 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:47.036944    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6" podStartSLOduration=17.337622916 podStartE2EDuration="19.036899976s" totalImagesPullingTime="1.69927706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:47.036121985 +0000 UTC m=+270.511814980" watchObservedRunningTime="2026-09-09 21:12:47.036899976 +0000 UTC m=+270.512592972"
Sep 09 21:12:48.313385 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:48.313338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:48.315853 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:48.315832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqqd2\" (UID: \"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396\") " pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:48.441206 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:48.441170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqqd2"
Sep 09 21:12:48.714671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:48.714600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqqd2"]
Sep 09 21:12:48.717345 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:12:48.717322    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ccfeaa_9c9c_45f6_8eb4_0ebec5b9b396.slice/crio-be1f8f2fada19c4931ac254f4a2a5c3271e743c3a350daa45a506b9c333706f1 WatchSource:0}: Error finding container be1f8f2fada19c4931ac254f4a2a5c3271e743c3a350daa45a506b9c333706f1: Status 404 returned error can't find the container with id be1f8f2fada19c4931ac254f4a2a5c3271e743c3a350daa45a506b9c333706f1
Sep 09 21:12:49.023519 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:49.023487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqqd2" event={"ID":"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396","Type":"ContainerStarted","Data":"d8e7aee1b66cf9d1d9b70f612a11c6040a9fb60b6a42d3b1915e5e0f0c98ae69"}
Sep 09 21:12:49.023691 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:49.023547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqqd2" event={"ID":"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396","Type":"ContainerStarted","Data":"be1f8f2fada19c4931ac254f4a2a5c3271e743c3a350daa45a506b9c333706f1"}
Sep 09 21:12:50.029001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:50.028962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqqd2" event={"ID":"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396","Type":"ContainerStarted","Data":"96ec186789ac1ec515ad978ee0f9d08daffd7e16db8c647a29b70c47571914a3"}
Sep 09 21:12:51.033298 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:51.033264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqqd2" event={"ID":"82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396","Type":"ContainerStarted","Data":"967d9982d35374e3388a96fcd82417c2f58f3c7178052c85ca02c0dd4c0f0b6d"}
Sep 09 21:12:51.057140 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:51.057096    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pqqd2" podStartSLOduration=16.961263144 podStartE2EDuration="19.05708231s" totalImagesPullingTime="2.095819166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:12:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:12:51.056824741 +0000 UTC m=+274.532517736" watchObservedRunningTime="2026-09-09 21:12:51.05708231 +0000 UTC m=+274.532775305"
Sep 09 21:12:53.025402 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:53.025367    2580 scope.go:117] "RemoveContainer" containerID="4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa"
Sep 09 21:12:54.045903 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:54.045877    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:12:54.046439 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:54.046324    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/1.log"
Sep 09 21:12:54.046439 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:54.046371    2580 generic.go:356] "Generic (PLEG): container finished" podID="80682f72-2926-44f1-bb38-2047d487fabc" containerID="0641c199bc0c9bbc04ec35e72b6d77df237532539f5013d9c1ac1dc5700d2e1e" exitCode=255
Sep 09 21:12:54.046536 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:54.046444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-x4w78" event={"ID":"80682f72-2926-44f1-bb38-2047d487fabc","Type":"ContainerDied","Data":"0641c199bc0c9bbc04ec35e72b6d77df237532539f5013d9c1ac1dc5700d2e1e"}
Sep 09 21:12:54.046536 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:54.046503    2580 scope.go:117] "RemoveContainer" containerID="4e74638e2221810c0d641c63cf62e9ec4878b48622e58e14bdf89145c7f46bfa"
Sep 09 21:12:54.046832 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:54.046812    2580 scope.go:117] "RemoveContainer" containerID="0641c199bc0c9bbc04ec35e72b6d77df237532539f5013d9c1ac1dc5700d2e1e"
Sep 09 21:12:54.047017 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:54.046993    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-x4w78_openshift-console-operator(80682f72-2926-44f1-bb38-2047d487fabc)\"" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podUID="80682f72-2926-44f1-bb38-2047d487fabc"
Sep 09 21:12:55.050661 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:55.050631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:12:57.706208 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:57.706155    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6n25h" podUID="24873d71-47c5-4f54-8514-6a45b864864e"
Sep 09 21:12:58.060194 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:58.060167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6n25h"
Sep 09 21:12:58.830330 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:58.830276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:58.830693 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:58.830353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:12:58.830693 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:12:58.830664    2580 scope.go:117] "RemoveContainer" containerID="0641c199bc0c9bbc04ec35e72b6d77df237532539f5013d9c1ac1dc5700d2e1e"
Sep 09 21:12:58.830825 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:12:58.830806    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-x4w78_openshift-console-operator(80682f72-2926-44f1-bb38-2047d487fabc)\"" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podUID="80682f72-2926-44f1-bb38-2047d487fabc"
Sep 09 21:13:00.407797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.407758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:13:00.407797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.407805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:00.408560 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.408543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c915d66-6764-4ea7-8ffe-c4a5f10ae579-service-ca-bundle\") pod \"router-default-5589f67c66-9ztht\" (UID: \"3c915d66-6764-4ea7-8ffe-c4a5f10ae579\") " pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:00.410400 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.410380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9fc6dede-5a02-46ae-9061-ef114771785e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jsrhv\" (UID: \"9fc6dede-5a02-46ae-9061-ef114771785e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:13:00.615351 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.615323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"
Sep 09 21:13:00.653027 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.652992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:00.888262 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.888234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv"]
Sep 09 21:13:00.891191 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:13:00.891166    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc6dede_5a02_46ae_9061_ef114771785e.slice/crio-624a48cb2bce81e5957a9c2648ef75e30ed23beb2abec9275b199771a2ba3dd6 WatchSource:0}: Error finding container 624a48cb2bce81e5957a9c2648ef75e30ed23beb2abec9275b199771a2ba3dd6: Status 404 returned error can't find the container with id 624a48cb2bce81e5957a9c2648ef75e30ed23beb2abec9275b199771a2ba3dd6
Sep 09 21:13:00.913031 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.912496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:13:00.915795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.915636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24873d71-47c5-4f54-8514-6a45b864864e-metrics-tls\") pod \"dns-default-6n25h\" (UID: \"24873d71-47c5-4f54-8514-6a45b864864e\") " pod="openshift-dns/dns-default-6n25h"
Sep 09 21:13:00.930638 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:00.930616    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5589f67c66-9ztht"]
Sep 09 21:13:00.932607 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:13:00.932582    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c915d66_6764_4ea7_8ffe_c4a5f10ae579.slice/crio-36bcae675f25c27f54996167e534c167b54120d4e1013e7fb64553f0f4469ea4 WatchSource:0}: Error finding container 36bcae675f25c27f54996167e534c167b54120d4e1013e7fb64553f0f4469ea4: Status 404 returned error can't find the container with id 36bcae675f25c27f54996167e534c167b54120d4e1013e7fb64553f0f4469ea4
Sep 09 21:13:01.064754 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.064722    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rdjz\""
Sep 09 21:13:01.070957 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.070904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5589f67c66-9ztht" event={"ID":"3c915d66-6764-4ea7-8ffe-c4a5f10ae579","Type":"ContainerStarted","Data":"b882fdeaa022dbe7811cc79f3df8b308485531cf3415cabbc0190d2391c8a9ff"}
Sep 09 21:13:01.071085 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.070982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5589f67c66-9ztht" event={"ID":"3c915d66-6764-4ea7-8ffe-c4a5f10ae579","Type":"ContainerStarted","Data":"36bcae675f25c27f54996167e534c167b54120d4e1013e7fb64553f0f4469ea4"}
Sep 09 21:13:01.071543 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.071519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6n25h"
Sep 09 21:13:01.072186 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.072160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv" event={"ID":"9fc6dede-5a02-46ae-9061-ef114771785e","Type":"ContainerStarted","Data":"624a48cb2bce81e5957a9c2648ef75e30ed23beb2abec9275b199771a2ba3dd6"}
Sep 09 21:13:01.097267 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.097223    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5589f67c66-9ztht" podStartSLOduration=33.097208147 podStartE2EDuration="33.097208147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:13:01.096147388 +0000 UTC m=+284.571840427" watchObservedRunningTime="2026-09-09 21:13:01.097208147 +0000 UTC m=+284.572901132"
Sep 09 21:13:01.350518 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.350380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6n25h"]
Sep 09 21:13:01.352983 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:13:01.352960    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24873d71_47c5_4f54_8514_6a45b864864e.slice/crio-74c08a07a9c5af3ed520b9373314955bb614b462661faa6483fb5aa2c67614ff WatchSource:0}: Error finding container 74c08a07a9c5af3ed520b9373314955bb614b462661faa6483fb5aa2c67614ff: Status 404 returned error can't find the container with id 74c08a07a9c5af3ed520b9373314955bb614b462661faa6483fb5aa2c67614ff
Sep 09 21:13:01.653722 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.653647    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:01.656145 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:01.656124    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:02.078141 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:02.078062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6n25h" event={"ID":"24873d71-47c5-4f54-8514-6a45b864864e","Type":"ContainerStarted","Data":"74c08a07a9c5af3ed520b9373314955bb614b462661faa6483fb5aa2c67614ff"}
Sep 09 21:13:02.078433 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:02.078408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:02.079875 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:02.079848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5589f67c66-9ztht"
Sep 09 21:13:04.086964 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.086930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv" event={"ID":"9fc6dede-5a02-46ae-9061-ef114771785e","Type":"ContainerStarted","Data":"7abb00e5e6d658999487322080ec2a30cde053a25870837f6eef824216d2a37c"}
Sep 09 21:13:04.089086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.089056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6n25h" event={"ID":"24873d71-47c5-4f54-8514-6a45b864864e","Type":"ContainerStarted","Data":"96d63730ac461e54553fefed1fa559e71c3864780e32fa93869263b3d1fe76c3"}
Sep 09 21:13:04.089218 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.089115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6n25h" event={"ID":"24873d71-47c5-4f54-8514-6a45b864864e","Type":"ContainerStarted","Data":"c9a702e8f345f19958451d9c0938ef93cbda74a5cf8146ba3a288cb7fa82fb80"}
Sep 09 21:13:04.105053 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.105003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jsrhv" podStartSLOduration=33.796034872 podStartE2EDuration="36.104984131s" totalImagesPullingTime="2.308949259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:13:04.104383558 +0000 UTC m=+287.580076555" watchObservedRunningTime="2026-09-09 21:13:04.104984131 +0000 UTC m=+287.580677125"
Sep 09 21:13:04.122110 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.122051    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6n25h" podStartSLOduration=252.27247062 podStartE2EDuration="4m14.122032488s" totalImagesPullingTime="1.849561868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:13:04.121152412 +0000 UTC m=+287.596845407" watchObservedRunningTime="2026-09-09 21:13:04.122032488 +0000 UTC m=+287.597725483"
Sep 09 21:13:04.450333 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.450246    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:04.450333 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:04.450307    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:05.092899 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:05.092867    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6n25h"
Sep 09 21:13:06.016849 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:06.016815    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:06.017025 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:06.016864    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:10.027312 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:13:10.027274    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lvlqx" podUID="9e9802d4-8b0b-42f7-8be7-779d96efe850"
Sep 09 21:13:11.026156 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:11.026127    2580 scope.go:117] "RemoveContainer" containerID="0641c199bc0c9bbc04ec35e72b6d77df237532539f5013d9c1ac1dc5700d2e1e"
Sep 09 21:13:11.026329 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:13:11.026283    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-x4w78_openshift-console-operator(80682f72-2926-44f1-bb38-2047d487fabc)\"" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podUID="80682f72-2926-44f1-bb38-2047d487fabc"
Sep 09 21:13:14.450191 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:14.450157    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:14.450667 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:14.450213    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:15.098104 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:15.098075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6n25h"
Sep 09 21:13:16.017064 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:16.017024    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:16.017459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:16.017090    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:16.896262 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:16.896225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:13:16.896877 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:16.896849    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:13:16.907039 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:16.907017    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 21:13:24.025677 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.025647    2580 scope.go:117] "RemoveContainer" containerID="0641c199bc0c9bbc04ec35e72b6d77df237532539f5013d9c1ac1dc5700d2e1e"
Sep 09 21:13:24.153384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.153360    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:13:24.153524 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.153435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-x4w78" event={"ID":"80682f72-2926-44f1-bb38-2047d487fabc","Type":"ContainerStarted","Data":"4c976b4f4659915c84dbcccd2d7aa7486402f4846829691e9b7c96c29f6da4fb"}
Sep 09 21:13:24.153714 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.153694    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:13:24.172236 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.172193    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-x4w78" podStartSLOduration=53.714995397 podStartE2EDuration="56.172179976s" totalImagesPullingTime="2.457184579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:13:24.171401816 +0000 UTC m=+307.647094811" watchObservedRunningTime="2026-09-09 21:13:24.172179976 +0000 UTC m=+307.647872970"
Sep 09 21:13:24.450376 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.450304    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:24.450376 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.450348    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:24.450570 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.450382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:13:24.450804 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.450768    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"0e447208697adc90f66376899c24d2f92ff00190243a415de52af125b10eee2e"} pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:13:24.454412 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.454388    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:24.454530 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.454428    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:24.816250 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:24.816222    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-x4w78"
Sep 09 21:13:25.024841 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:25.024813    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:13:34.455001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:34.454971    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:34.455378 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:34.455024    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:44.454269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:44.454237    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:13:44.454782 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:44.454290    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:13:49.469296 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:49.469251    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" containerID="cri-o://0e447208697adc90f66376899c24d2f92ff00190243a415de52af125b10eee2e" gracePeriod=30
Sep 09 21:13:50.237057 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:50.237028    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fab6916-acad-468b-91ce-213e491d68b8" containerID="0e447208697adc90f66376899c24d2f92ff00190243a415de52af125b10eee2e" exitCode=0
Sep 09 21:13:50.237329 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:50.237073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"0e447208697adc90f66376899c24d2f92ff00190243a415de52af125b10eee2e"}
Sep 09 21:13:50.237329 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:50.237111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"6986c3611f61877c56ce0565a1ac7697f96138b3db841dab039d20a9bf84bb14"}
Sep 09 21:13:50.237329 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:50.237269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:13:55.539124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:55.539096    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:13:55.740654 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:55.740584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/3.log"
Sep 09 21:13:56.339634 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:56.339607    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6n25h_24873d71-47c5-4f54-8514-6a45b864864e/dns/0.log"
Sep 09 21:13:56.538851 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:56.538823    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6n25h_24873d71-47c5-4f54-8514-6a45b864864e/kube-rbac-proxy/0.log"
Sep 09 21:13:57.337788 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:57.337763    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hhpzm_9b35cf4a-843a-4f93-863b-a58b691a0160/dns-node-resolver/0.log"
Sep 09 21:13:57.739293 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:57.739218    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-576cd65d99-l9wm6_8fab6916-acad-468b-91ce-213e491d68b8/registry/0.log"
Sep 09 21:13:57.940938 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:57.940899    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-576cd65d99-l9wm6_8fab6916-acad-468b-91ce-213e491d68b8/registry/1.log"
Sep 09 21:13:58.739098 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:58.739073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhhk5_3b7c6098-17b4-46a2-b8ee-570590c8f867/node-ca/0.log"
Sep 09 21:13:59.139493 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:59.139469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5589f67c66-9ztht_3c915d66-6764-4ea7-8ffe-c4a5f10ae579/router/0.log"
Sep 09 21:13:59.538509 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:13:59.538462    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6njgl_f891665c-6986-421c-9bd8-3f482c2dbebf/serve-healthcheck-canary/0.log"
Sep 09 21:14:03.279684 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:03.279652    2580 generic.go:356] "Generic (PLEG): container finished" podID="2154ecdb-a3d4-495e-b2f2-6a5723c7376e" containerID="5ba46cc72f321e85d4a3124c4b995b4f20a5678b2a7a75deed5de37a62e5d89c" exitCode=0
Sep 09 21:14:03.280157 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:03.279725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s" event={"ID":"2154ecdb-a3d4-495e-b2f2-6a5723c7376e","Type":"ContainerDied","Data":"5ba46cc72f321e85d4a3124c4b995b4f20a5678b2a7a75deed5de37a62e5d89c"}
Sep 09 21:14:03.280157 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:03.280111    2580 scope.go:117] "RemoveContainer" containerID="5ba46cc72f321e85d4a3124c4b995b4f20a5678b2a7a75deed5de37a62e5d89c"
Sep 09 21:14:04.285890 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:04.285858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-gbw4s" event={"ID":"2154ecdb-a3d4-495e-b2f2-6a5723c7376e","Type":"ContainerStarted","Data":"f2cb9a569d67d1bcf7e27805feef379f938a1e60248ee16cc2d0354159c7f32a"}
Sep 09 21:14:04.450907 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:04.450861    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:04.451092 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:04.450951    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:11.244300 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:11.244213    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:11.244300 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:11.244259    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:14.450346 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:14.450302    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:14.450776 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:14.450382    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:21.244433 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:21.244400    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:21.244885 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:21.244452    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:24.449753 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:24.449725    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:24.450161 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:24.449767    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:24.450161 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:24.449801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:14:24.450246 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:24.450190    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"6986c3611f61877c56ce0565a1ac7697f96138b3db841dab039d20a9bf84bb14"} pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:14:24.453827 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:24.453803    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:24.453969 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:24.453849    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:29.830999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:29.830962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:14:29.833353 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:29.833336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e9802d4-8b0b-42f7-8be7-779d96efe850-metrics-certs\") pod \"network-metrics-daemon-lvlqx\" (UID: \"9e9802d4-8b0b-42f7-8be7-779d96efe850\") " pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:14:30.128815 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:30.128747    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gdn8f\""
Sep 09 21:14:30.135850 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:30.135829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvlqx"
Sep 09 21:14:30.408586 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:30.408522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvlqx"]
Sep 09 21:14:30.413021 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:14:30.412996    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9802d4_8b0b_42f7_8be7_779d96efe850.slice/crio-8c91f33187da07a5fea403919e935890638ecd1b98bd1ec34918df01b2cba273 WatchSource:0}: Error finding container 8c91f33187da07a5fea403919e935890638ecd1b98bd1ec34918df01b2cba273: Status 404 returned error can't find the container with id 8c91f33187da07a5fea403919e935890638ecd1b98bd1ec34918df01b2cba273
Sep 09 21:14:30.415020 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:30.415005    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:14:31.371068 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:31.371029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvlqx" event={"ID":"9e9802d4-8b0b-42f7-8be7-779d96efe850","Type":"ContainerStarted","Data":"8c91f33187da07a5fea403919e935890638ecd1b98bd1ec34918df01b2cba273"}
Sep 09 21:14:32.376669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:32.376636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvlqx" event={"ID":"9e9802d4-8b0b-42f7-8be7-779d96efe850","Type":"ContainerStarted","Data":"e3dc2bc576567bd0a0d4bec8d8ca7433d53c99b0d0ba9a7da00de78648e20b48"}
Sep 09 21:14:32.377065 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:32.376685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvlqx" event={"ID":"9e9802d4-8b0b-42f7-8be7-779d96efe850","Type":"ContainerStarted","Data":"cec569b3ec9c63b8ad4e22699e6abd707d6649a076bf1f9ec21369072630a1af"}
Sep 09 21:14:32.394600 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:32.394550    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lvlqx" podStartSLOduration=374.281675767 podStartE2EDuration="6m15.394534595s" totalImagesPullingTime="1.112858828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:14:32.39432909 +0000 UTC m=+375.870022084" watchObservedRunningTime="2026-09-09 21:14:32.394534595 +0000 UTC m=+375.870227589"
Sep 09 21:14:34.454796 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:34.454766    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:34.455269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:34.454819    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:44.454480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:44.454448    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:14:44.454821 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:44.454496    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:14:49.468384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:49.468317    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" containerID="cri-o://6986c3611f61877c56ce0565a1ac7697f96138b3db841dab039d20a9bf84bb14" gracePeriod=30
Sep 09 21:14:50.439393 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:50.439359    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fab6916-acad-468b-91ce-213e491d68b8" containerID="6986c3611f61877c56ce0565a1ac7697f96138b3db841dab039d20a9bf84bb14" exitCode=0
Sep 09 21:14:50.439736 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:50.439436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"6986c3611f61877c56ce0565a1ac7697f96138b3db841dab039d20a9bf84bb14"}
Sep 09 21:14:50.439736 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:50.439497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"b86eca3617a69234df5d0ea294865f738da4e09de7cc13aed72a33ef72175b6c"}
Sep 09 21:14:50.439736 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:50.439523    2580 scope.go:117] "RemoveContainer" containerID="0e447208697adc90f66376899c24d2f92ff00190243a415de52af125b10eee2e"
Sep 09 21:14:50.439736 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:14:50.439680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:15:04.450120 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:04.450091    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:04.450499 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:04.450137    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:11.448255 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:11.448223    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:11.448619 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:11.448282    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:14.449731 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:14.449699    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:14.450084 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:14.449754    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:21.448540 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:21.448506    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:21.448959 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:21.448568    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:24.449295 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:24.449266    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:24.449661 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:24.449327    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:24.449661 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:24.449369    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:15:24.449859 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:24.449836    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"b86eca3617a69234df5d0ea294865f738da4e09de7cc13aed72a33ef72175b6c"} pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:15:24.453304 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:24.453280    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:24.453411 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:24.453323    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:34.453822 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:34.453791    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:34.454256 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:34.453839    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:44.453589 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:44.453512    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:15:44.454018 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:44.453583    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:15:49.468008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:49.467970    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" containerID="cri-o://b86eca3617a69234df5d0ea294865f738da4e09de7cc13aed72a33ef72175b6c" gracePeriod=30
Sep 09 21:15:49.620442 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:49.620419    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fab6916-acad-468b-91ce-213e491d68b8" containerID="b86eca3617a69234df5d0ea294865f738da4e09de7cc13aed72a33ef72175b6c" exitCode=0
Sep 09 21:15:49.620559 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:49.620497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"b86eca3617a69234df5d0ea294865f738da4e09de7cc13aed72a33ef72175b6c"}
Sep 09 21:15:49.620620 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:49.620580    2580 scope.go:117] "RemoveContainer" containerID="6986c3611f61877c56ce0565a1ac7697f96138b3db841dab039d20a9bf84bb14"
Sep 09 21:15:50.626355 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:50.626323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"53a4927c280850da21749ff4f78554a3d02332ec9b93a91e4c2fb44bc2b92c0c"}
Sep 09 21:15:50.626703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:15:50.626410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:16:04.450108 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:04.450071    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:04.450462 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:04.450128    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:11.634343 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:11.634301    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:11.634720 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:11.634361    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:14.449297 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:14.449253    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:14.449662 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:14.449322    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:21.633855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:21.633825    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:21.634310 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:21.633880    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:24.449583 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:24.449551    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:24.450033 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:24.449610    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:24.450033 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:24.449653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:16:24.450202 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:24.450164    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"53a4927c280850da21749ff4f78554a3d02332ec9b93a91e4c2fb44bc2b92c0c"} pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:16:24.453406 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:24.453386    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:24.453494 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:24.453419    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:34.454027 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:34.453984    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:34.454399 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:34.454062    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:44.453487 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:44.453456    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:16:44.453822 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:44.453504    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:16:49.468165 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:49.468126    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" containerID="cri-o://53a4927c280850da21749ff4f78554a3d02332ec9b93a91e4c2fb44bc2b92c0c" gracePeriod=30
Sep 09 21:16:49.818284 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:49.818256    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fab6916-acad-468b-91ce-213e491d68b8" containerID="53a4927c280850da21749ff4f78554a3d02332ec9b93a91e4c2fb44bc2b92c0c" exitCode=0
Sep 09 21:16:49.818416 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:49.818321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"53a4927c280850da21749ff4f78554a3d02332ec9b93a91e4c2fb44bc2b92c0c"}
Sep 09 21:16:49.818416 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:49.818367    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"4c2588471a6db70d5df6e6112b00e38e8a4f19ed0beffdfd5b19189657529797"}
Sep 09 21:16:49.818416 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:49.818392    2580 scope.go:117] "RemoveContainer" containerID="b86eca3617a69234df5d0ea294865f738da4e09de7cc13aed72a33ef72175b6c"
Sep 09 21:16:49.818556 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:16:49.818534    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:17:04.449353 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:04.449323    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:04.449762 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:04.449375    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:10.827731 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:10.827650    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:10.827731 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:10.827704    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:14.449322 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:14.449291    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:14.449683 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:14.449345    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:20.828337 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:20.828307    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:20.828765 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:20.828358    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:24.449246 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:24.449216    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:24.449655 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:24.449255    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:24.449655 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:24.449284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:17:24.449655 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:24.449620    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"4c2588471a6db70d5df6e6112b00e38e8a4f19ed0beffdfd5b19189657529797"} pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:17:24.453090 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:24.453065    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:24.453231 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:24.453109    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:34.456438 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:34.456407    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:34.456962 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:34.456458    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:44.453876 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:44.453841    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:17:44.454397 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:44.453903    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:17:49.467047 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:49.467005    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" containerID="cri-o://4c2588471a6db70d5df6e6112b00e38e8a4f19ed0beffdfd5b19189657529797" gracePeriod=30
Sep 09 21:17:50.000228 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:50.000195    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fab6916-acad-468b-91ce-213e491d68b8" containerID="4c2588471a6db70d5df6e6112b00e38e8a4f19ed0beffdfd5b19189657529797" exitCode=0
Sep 09 21:17:50.000448 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:50.000236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"4c2588471a6db70d5df6e6112b00e38e8a4f19ed0beffdfd5b19189657529797"}
Sep 09 21:17:50.000448 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:50.000286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerStarted","Data":"2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a"}
Sep 09 21:17:50.000448 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:50.000310    2580 scope.go:117] "RemoveContainer" containerID="53a4927c280850da21749ff4f78554a3d02332ec9b93a91e4c2fb44bc2b92c0c"
Sep 09 21:17:50.000628 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:17:50.000454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:18:04.449021 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:04.448991    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:04.449430 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:04.449039    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:11.011424 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:11.011394    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:11.011939 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:11.011446    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:14.449075 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:14.449044    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:14.449400 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:14.449085    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:16.915471 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:16.915445    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:18:16.916808 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:16.916784    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:18:21.009417 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:21.009386    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:21.009758 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:21.009437    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:24.450009 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:24.449973    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:24.452327 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:24.450025    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:24.452327 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:24.450063    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:18:24.452327 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:24.450449    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a"} pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" containerMessage="Container registry failed liveness probe, will be restarted"
Sep 09 21:18:24.453889 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:24.453863    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:24.454014 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:24.453907    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:33.093372 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.093341    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:18:33.093372 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.093369    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:18:33.093372 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.093380    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:33.093811 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.093433    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:18:33.593418299 +0000 UTC m=+617.069111271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:33.597263 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.597233    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:18:33.597263 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.597262    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:18:33.597263 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.597271    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:33.597508 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:33.597318    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:18:34.597304909 +0000 UTC m=+618.072997881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:34.454218 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:34.454183    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:34.454585 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:34.454233    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:34.604111 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:34.604079    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:18:34.604111 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:34.604106    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:18:34.604111 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:34.604116    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:34.604334 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:34.604159    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:18:36.604146611 +0000 UTC m=+620.079839583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:36.618773 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:36.618725    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:18:36.618773 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:36.618770    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:18:36.618773 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:36.618784    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:36.619347 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:36.618856    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:18:40.618838004 +0000 UTC m=+624.094530977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:40.650068 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:40.649989    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:18:40.650068 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:40.650017    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:18:40.650068 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:40.650027    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:40.650486 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:40.650073    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:18:48.650060006 +0000 UTC m=+632.125752978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:44.454470 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:44.454430    2580 patch_prober.go:28] interesting pod/image-registry-576cd65d99-l9wm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 21:18:44.454830 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:44.454488    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 21:18:48.702952 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:48.702894    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:18:48.702952 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:48.702948    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:18:48.702952 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:48.702957    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:48.703395 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:48.702998    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:04.702985956 +0000 UTC m=+648.178678928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:18:49.468555 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:49.468511    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry" containerID="cri-o://2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a" gracePeriod=30
Sep 09 21:18:49.584841 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:49.584818    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-576cd65d99-l9wm6_openshift-image-registry(8fab6916-acad-468b-91ce-213e491d68b8)\"" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8"
Sep 09 21:18:50.191594 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:50.191566    2580 generic.go:356] "Generic (PLEG): container finished" podID="8fab6916-acad-468b-91ce-213e491d68b8" containerID="2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a" exitCode=0
Sep 09 21:18:50.191984 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:50.191610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a"}
Sep 09 21:18:50.191984 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:50.191646    2580 scope.go:117] "RemoveContainer" containerID="4c2588471a6db70d5df6e6112b00e38e8a4f19ed0beffdfd5b19189657529797"
Sep 09 21:18:50.191984 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:18:50.191870    2580 scope.go:117] "RemoveContainer" containerID="2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a"
Sep 09 21:18:50.192118 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:18:50.192053    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-576cd65d99-l9wm6_openshift-image-registry(8fab6916-acad-468b-91ce-213e491d68b8)\"" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8"
Sep 09 21:19:01.025680 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:01.025644    2580 scope.go:117] "RemoveContainer" containerID="2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a"
Sep 09 21:19:01.026161 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:01.025804    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=registry pod=image-registry-576cd65d99-l9wm6_openshift-image-registry(8fab6916-acad-468b-91ce-213e491d68b8)\"" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" podUID="8fab6916-acad-468b-91ce-213e491d68b8"
Sep 09 21:19:04.711439 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:04.711409    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: configmap "kube-root-ca.crt" not found
Sep 09 21:19:04.711439 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:04.711436    2580 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
Sep 09 21:19:04.711439 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:04.711446    2580 projected.go:196] Error preparing data for projected volume kube-api-access-2zgfr for pod openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rk9p6: [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:19:04.711819 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:04.711503    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr podName:71fcf886-ba5f-4f01-aa86-46b20c46ddf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:36.711486144 +0000 UTC m=+680.187179132 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zgfr" (UniqueName: "kubernetes.io/projected/71fcf886-ba5f-4f01-aa86-46b20c46ddf5-kube-api-access-2zgfr") pod "cluster-samples-operator-7cdcfcf76c-rk9p6" (UID: "71fcf886-ba5f-4f01-aa86-46b20c46ddf5") : [configmap "kube-root-ca.crt" not found, configmap "openshift-service-ca.crt" not found]
Sep 09 21:19:10.244264 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.244230    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-576cd65d99-l9wm6"]
Sep 09 21:19:10.255389 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.255365    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-thhcz"]
Sep 09 21:19:10.258134 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.258119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:10.261044 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.261021    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8565cf9fbd-q8s26"]
Sep 09 21:19:10.261578 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.261541    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 21:19:10.261685 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.261612    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 21:19:10.261685 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.261676    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2f55h\""
Sep 09 21:19:10.263958 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.263943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.266782 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.266708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rvbdz\""
Sep 09 21:19:10.266899 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.266846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 21:19:10.267486 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.267470    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 21:19:10.267644 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.267618    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 21:19:10.267959 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.267940    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 21:19:10.270738 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.270718    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 21:19:10.275395 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.275376    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 21:19:10.282346 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.282300    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-thhcz"]
Sep 09 21:19:10.283222 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.283182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8565cf9fbd-q8s26"]
Sep 09 21:19:10.350022 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.349995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-trusted-ca-bundle\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.350172 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24n8\" (UniqueName: \"kubernetes.io/projected/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-kube-api-access-f24n8\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.350172 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-serving-cert\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.350172 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-config\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.350330 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cnk\" (UniqueName: \"kubernetes.io/projected/edd1a462-d99e-4b97-b3a6-a28fa975d151-kube-api-access-q4cnk\") pod \"downloads-85d98c998f-thhcz\" (UID: \"edd1a462-d99e-4b97-b3a6-a28fa975d151\") " pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:10.350330 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-service-ca\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.350330 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-oauth-config\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.350478 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.350337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-oauth-serving-cert\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.375332 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.375313    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:19:10.451423 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-service-ca\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451552 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-oauth-config\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451552 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-oauth-serving-cert\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451552 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-trusted-ca-bundle\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451719 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f24n8\" (UniqueName: \"kubernetes.io/projected/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-kube-api-access-f24n8\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451719 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-serving-cert\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451719 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-config\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.451719 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.451695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cnk\" (UniqueName: \"kubernetes.io/projected/edd1a462-d99e-4b97-b3a6-a28fa975d151-kube-api-access-q4cnk\") pod \"downloads-85d98c998f-thhcz\" (UID: \"edd1a462-d99e-4b97-b3a6-a28fa975d151\") " pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:10.452285 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.452255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-oauth-serving-cert\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.452285 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.452266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-service-ca\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.452604 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.452309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-trusted-ca-bundle\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.452604 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.452389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-config\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.453867 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.453839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-oauth-config\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.454150 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.454132    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-serving-cert\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.489511 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.489489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cnk\" (UniqueName: \"kubernetes.io/projected/edd1a462-d99e-4b97-b3a6-a28fa975d151-kube-api-access-q4cnk\") pod \"downloads-85d98c998f-thhcz\" (UID: \"edd1a462-d99e-4b97-b3a6-a28fa975d151\") " pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:10.489863 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.489845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24n8\" (UniqueName: \"kubernetes.io/projected/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-kube-api-access-f24n8\") pod \"console-8565cf9fbd-q8s26\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") " pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.551882 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.551862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-registry-certificates\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.551985 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.551892    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-image-registry-private-configuration\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.551985 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.551938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.551985 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.551970    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fab6916-acad-468b-91ce-213e491d68b8-ca-trust-extracted\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.552124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.552033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h75zl\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-kube-api-access-h75zl\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.552124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.552063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-trusted-ca\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.552124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.552089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-installation-pull-secrets\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.552260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.552129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-bound-sa-token\") pod \"8fab6916-acad-468b-91ce-213e491d68b8\" (UID: \"8fab6916-acad-468b-91ce-213e491d68b8\") "
Sep 09 21:19:10.552311 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.552259    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:10.552614 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.552588    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:10.554265 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.554239    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-kube-api-access-h75zl" (OuterVolumeSpecName: "kube-api-access-h75zl") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "kube-api-access-h75zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:10.554353 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.554269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:10.554407 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.554397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:19:10.554446 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.554404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:19:10.554599 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.554576    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:19:10.560740 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.560719    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fab6916-acad-468b-91ce-213e491d68b8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8fab6916-acad-468b-91ce-213e491d68b8" (UID: "8fab6916-acad-468b-91ce-213e491d68b8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 21:19:10.569330 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.569312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:10.575575 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.575553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:10.653735 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653701    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-trusted-ca\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653752    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-installation-pull-secrets\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653768    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-bound-sa-token\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653782    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8fab6916-acad-468b-91ce-213e491d68b8-registry-certificates\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653795    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8fab6916-acad-468b-91ce-213e491d68b8-image-registry-private-configuration\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653831    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-registry-tls\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653844    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8fab6916-acad-468b-91ce-213e491d68b8-ca-trust-extracted\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.653855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.653856    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h75zl\" (UniqueName: \"kubernetes.io/projected/8fab6916-acad-468b-91ce-213e491d68b8-kube-api-access-h75zl\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:10.883115 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.883090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8565cf9fbd-q8s26"]
Sep 09 21:19:10.884657 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:10.884634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-thhcz"]
Sep 09 21:19:10.885505 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:10.885483    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd1a462_d99e_4b97_b3a6_a28fa975d151.slice/crio-221b60c373f8f52b1c8cb315b8e2737ab99f73e3293ad72a5f47bec0ddbca011 WatchSource:0}: Error finding container 221b60c373f8f52b1c8cb315b8e2737ab99f73e3293ad72a5f47bec0ddbca011: Status 404 returned error can't find the container with id 221b60c373f8f52b1c8cb315b8e2737ab99f73e3293ad72a5f47bec0ddbca011
Sep 09 21:19:10.886092 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:10.886072    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d2e0d0_c386_4cd6_9621_67996aea0ce2.slice/crio-0c393d5a49a5230c4f92d88a4bd4a02fc6931f30dde307782490505e8286c452 WatchSource:0}: Error finding container 0c393d5a49a5230c4f92d88a4bd4a02fc6931f30dde307782490505e8286c452: Status 404 returned error can't find the container with id 0c393d5a49a5230c4f92d88a4bd4a02fc6931f30dde307782490505e8286c452
Sep 09 21:19:11.260437 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.260375    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6"
Sep 09 21:19:11.260813 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.260375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576cd65d99-l9wm6" event={"ID":"8fab6916-acad-468b-91ce-213e491d68b8","Type":"ContainerDied","Data":"c7b0d204230d9f7967c3aa33a47903f43a191d17abd672ceaa8391e3ea29b3c0"}
Sep 09 21:19:11.260813 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.260526    2580 scope.go:117] "RemoveContainer" containerID="2d89a7702ed081f453f5824229b245ab18869fae0c7909e45c78d9e74e6e854a"
Sep 09 21:19:11.262275 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.262150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565cf9fbd-q8s26" event={"ID":"c8d2e0d0-c386-4cd6-9621-67996aea0ce2","Type":"ContainerStarted","Data":"0c393d5a49a5230c4f92d88a4bd4a02fc6931f30dde307782490505e8286c452"}
Sep 09 21:19:11.264478 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.264450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-thhcz" event={"ID":"edd1a462-d99e-4b97-b3a6-a28fa975d151","Type":"ContainerStarted","Data":"221b60c373f8f52b1c8cb315b8e2737ab99f73e3293ad72a5f47bec0ddbca011"}
Sep 09 21:19:11.308604 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.308577    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-576cd65d99-l9wm6"]
Sep 09 21:19:11.371794 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:11.371745    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-576cd65d99-l9wm6"]
Sep 09 21:19:13.015786 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.015751    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-755c8"]
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016098    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016113    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016129    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016138    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016152    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016160    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016171    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016179    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016191    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016199    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016211    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016220    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016276    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016287    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016295    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016304    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016312    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.016797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.016420    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fab6916-acad-468b-91ce-213e491d68b8" containerName="registry"
Sep 09 21:19:13.019568 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.019540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.031432 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.031285    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 21:19:13.031432 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.031297    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fab6916-acad-468b-91ce-213e491d68b8" path="/var/lib/kubelet/pods/8fab6916-acad-468b-91ce-213e491d68b8/volumes"
Sep 09 21:19:13.032721 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.032639    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 21:19:13.032806 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.032724    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 21:19:13.032806 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.032749    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9cmv8\""
Sep 09 21:19:13.058685 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.058662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-755c8"]
Sep 09 21:19:13.173485 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.173455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eac9db12-6af9-4d19-8d76-692b77b243cf-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.173703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.173509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhw9\" (UniqueName: \"kubernetes.io/projected/eac9db12-6af9-4d19-8d76-692b77b243cf-kube-api-access-hkhw9\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.173703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.173568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eac9db12-6af9-4d19-8d76-692b77b243cf-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.173703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.173619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eac9db12-6af9-4d19-8d76-692b77b243cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.274086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.273982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhw9\" (UniqueName: \"kubernetes.io/projected/eac9db12-6af9-4d19-8d76-692b77b243cf-kube-api-access-hkhw9\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.274086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.274058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eac9db12-6af9-4d19-8d76-692b77b243cf-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.274287 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.274107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eac9db12-6af9-4d19-8d76-692b77b243cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.274287 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.274130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eac9db12-6af9-4d19-8d76-692b77b243cf-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.274888 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.274840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eac9db12-6af9-4d19-8d76-692b77b243cf-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.277627 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.277583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eac9db12-6af9-4d19-8d76-692b77b243cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.277744 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.277636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eac9db12-6af9-4d19-8d76-692b77b243cf-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.288346 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.288317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhw9\" (UniqueName: \"kubernetes.io/projected/eac9db12-6af9-4d19-8d76-692b77b243cf-kube-api-access-hkhw9\") pod \"prometheus-operator-6f4946db56-755c8\" (UID: \"eac9db12-6af9-4d19-8d76-692b77b243cf\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:13.332560 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:13.332533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8"
Sep 09 21:19:14.074640 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:14.074566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-755c8"]
Sep 09 21:19:14.077818 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:14.077788    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac9db12_6af9_4d19_8d76_692b77b243cf.slice/crio-aa622e7fdf02608144a9e5ab233871d508779383e257927724f4bf2c6f5e5939 WatchSource:0}: Error finding container aa622e7fdf02608144a9e5ab233871d508779383e257927724f4bf2c6f5e5939: Status 404 returned error can't find the container with id aa622e7fdf02608144a9e5ab233871d508779383e257927724f4bf2c6f5e5939
Sep 09 21:19:14.280811 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:14.280777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565cf9fbd-q8s26" event={"ID":"c8d2e0d0-c386-4cd6-9621-67996aea0ce2","Type":"ContainerStarted","Data":"e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848"}
Sep 09 21:19:14.282115 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:14.282086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8" event={"ID":"eac9db12-6af9-4d19-8d76-692b77b243cf","Type":"ContainerStarted","Data":"aa622e7fdf02608144a9e5ab233871d508779383e257927724f4bf2c6f5e5939"}
Sep 09 21:19:14.302527 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:14.302472    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8565cf9fbd-q8s26" podStartSLOduration=1.345079507 podStartE2EDuration="4.302453451s" totalImagesPullingTime="2.957373944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:14.301999405 +0000 UTC m=+657.777692399" watchObservedRunningTime="2026-09-09 21:19:14.302453451 +0000 UTC m=+657.778146447"
Sep 09 21:19:16.292686 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:16.292649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8" event={"ID":"eac9db12-6af9-4d19-8d76-692b77b243cf","Type":"ContainerStarted","Data":"e6cf9a46cbbea63cb6d7b30bbb532118a0cd41178d63ff7c45635cb29260e827"}
Sep 09 21:19:16.293125 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:16.292736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8" event={"ID":"eac9db12-6af9-4d19-8d76-692b77b243cf","Type":"ContainerStarted","Data":"0b2ad511b6b964f537d9f9474d500cedace2467a05e0097cbe509aed1de8f68f"}
Sep 09 21:19:16.318413 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:16.318369    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-755c8" podStartSLOduration=3.022787465 podStartE2EDuration="4.318353218s" totalImagesPullingTime="1.295565753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:16.316840046 +0000 UTC m=+659.792533040" watchObservedRunningTime="2026-09-09 21:19:16.318353218 +0000 UTC m=+659.794046211"
Sep 09 21:19:18.565994 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.563740    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"]
Sep 09 21:19:18.569028 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.568993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.574247 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.574221    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f98tx\""
Sep 09 21:19:18.575542 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.575162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 21:19:18.575542 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.575391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 21:19:18.608227 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.608206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"]
Sep 09 21:19:18.625747 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.625592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.625747 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.625656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.625747 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.625715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65bfa231-6570-48eb-99ff-723ad77a2cf5-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.625993 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.625803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7tl\" (UniqueName: \"kubernetes.io/projected/65bfa231-6570-48eb-99ff-723ad77a2cf5-kube-api-access-zc7tl\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.646594 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.646552    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pv9m2"]
Sep 09 21:19:18.650398 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.650380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.655737 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.655555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 21:19:18.655737 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.655610    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 21:19:18.655737 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.655623    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 21:19:18.656370 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.656104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-llcr5\""
Sep 09 21:19:18.726930 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.726875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-textfile\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.726930 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.726928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.726993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-tls\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-wtmp\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65bfa231-6570-48eb-99ff-723ad77a2cf5-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.727137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7tl\" (UniqueName: \"kubernetes.io/projected/65bfa231-6570-48eb-99ff-723ad77a2cf5-kube-api-access-zc7tl\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.727137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-root\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.727384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.727384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-sys\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2de1b83-d527-4855-b76a-e762f8e1744b-metrics-client-ca\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.727347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsp4\" (UniqueName: \"kubernetes.io/projected/f2de1b83-d527-4855-b76a-e762f8e1744b-kube-api-access-ncsp4\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.727652 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:18.727596    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 09 21:19:18.727706 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:18.727655    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-tls podName:65bfa231-6570-48eb-99ff-723ad77a2cf5 nodeName:}" failed. No retries permitted until 2026-09-09 21:19:19.227637359 +0000 UTC m=+662.703330334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-b5lwk" (UID: "65bfa231-6570-48eb-99ff-723ad77a2cf5") : secret "openshift-state-metrics-tls" not found
Sep 09 21:19:18.728434 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.728381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65bfa231-6570-48eb-99ff-723ad77a2cf5-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.730711 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.730687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.739586 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.739567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7tl\" (UniqueName: \"kubernetes.io/projected/65bfa231-6570-48eb-99ff-723ad77a2cf5-kube-api-access-zc7tl\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:18.827895 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.827745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-textfile\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.827895 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.827880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.827947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-tls\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.827972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-wtmp\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-root\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828116 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-textfile\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828349 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-sys\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828349 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2de1b83-d527-4855-b76a-e762f8e1744b-metrics-client-ca\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828349 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:18.828199    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 21:19:18.828349 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:19:18.828249    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-tls podName:f2de1b83-d527-4855-b76a-e762f8e1744b nodeName:}" failed. No retries permitted until 2026-09-09 21:19:19.328235128 +0000 UTC m=+662.803928101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-tls") pod "node-exporter-pv9m2" (UID: "f2de1b83-d527-4855-b76a-e762f8e1744b") : secret "node-exporter-tls" not found
Sep 09 21:19:18.828526 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsp4\" (UniqueName: \"kubernetes.io/projected/f2de1b83-d527-4855-b76a-e762f8e1744b-kube-api-access-ncsp4\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828526 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-wtmp\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.828629 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-sys\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.836117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.829460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2de1b83-d527-4855-b76a-e762f8e1744b-metrics-client-ca\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.836117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.829500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.836117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.828691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2de1b83-d527-4855-b76a-e762f8e1744b-root\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.840146 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.840118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:18.842231 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:18.842163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsp4\" (UniqueName: \"kubernetes.io/projected/f2de1b83-d527-4855-b76a-e762f8e1744b-kube-api-access-ncsp4\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:19.231571 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.231489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:19.234124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.234101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/65bfa231-6570-48eb-99ff-723ad77a2cf5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-b5lwk\" (UID: \"65bfa231-6570-48eb-99ff-723ad77a2cf5\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:19.331992 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.331960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-tls\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:19.334841 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.334817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2de1b83-d527-4855-b76a-e762f8e1744b-node-exporter-tls\") pod \"node-exporter-pv9m2\" (UID: \"f2de1b83-d527-4855-b76a-e762f8e1744b\") " pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:19.482424 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.482353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"
Sep 09 21:19:19.567130 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.566015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pv9m2"
Sep 09 21:19:19.578858 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:19.578823    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2de1b83_d527_4855_b76a_e762f8e1744b.slice/crio-43a335ce02ddd038b3a66b8a6135da714e16a2edad46e7a7b312e11b534cc357 WatchSource:0}: Error finding container 43a335ce02ddd038b3a66b8a6135da714e16a2edad46e7a7b312e11b534cc357: Status 404 returned error can't find the container with id 43a335ce02ddd038b3a66b8a6135da714e16a2edad46e7a7b312e11b534cc357
Sep 09 21:19:19.810862 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:19.810829    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bfa231_6570_48eb_99ff_723ad77a2cf5.slice/crio-adc0689b97d8c9f33759c546366c1ef2af2cf1c536798ba0879f10d19ffda9fe WatchSource:0}: Error finding container adc0689b97d8c9f33759c546366c1ef2af2cf1c536798ba0879f10d19ffda9fe: Status 404 returned error can't find the container with id adc0689b97d8c9f33759c546366c1ef2af2cf1c536798ba0879f10d19ffda9fe
Sep 09 21:19:19.814718 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:19.814677    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk"]
Sep 09 21:19:20.312410 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.312375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk" event={"ID":"65bfa231-6570-48eb-99ff-723ad77a2cf5","Type":"ContainerStarted","Data":"a8ef5c87ce0fa85eda8eb61a7420607b2e5891cca4b9d1c0935254b2157f8934"}
Sep 09 21:19:20.312586 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.312450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk" event={"ID":"65bfa231-6570-48eb-99ff-723ad77a2cf5","Type":"ContainerStarted","Data":"4cbfa6d7aca9284163e57f532561c3e5db118e92ea55b75de310152378e694fe"}
Sep 09 21:19:20.312586 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.312472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk" event={"ID":"65bfa231-6570-48eb-99ff-723ad77a2cf5","Type":"ContainerStarted","Data":"adc0689b97d8c9f33759c546366c1ef2af2cf1c536798ba0879f10d19ffda9fe"}
Sep 09 21:19:20.313953 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.313907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pv9m2" event={"ID":"f2de1b83-d527-4855-b76a-e762f8e1744b","Type":"ContainerStarted","Data":"43a335ce02ddd038b3a66b8a6135da714e16a2edad46e7a7b312e11b534cc357"}
Sep 09 21:19:20.575847 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.575814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:20.576316 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.575885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:20.581496 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.581472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:20.680106 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.680068    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68d5575578-n9bw2"]
Sep 09 21:19:20.684204 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.684172    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.689471 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 21:19:20.689471 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 21:19:20.689471 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 21:19:20.689802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p4h2c\""
Sep 09 21:19:20.689871 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 21:19:20.689871 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 21:19:20.689976 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.689802    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bcf9tlnq7caip\""
Sep 09 21:19:20.712482 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.712448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d5575578-n9bw2"]
Sep 09 21:19:20.744063 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744168 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744168 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-metrics-client-ca\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744168 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpt2r\" (UniqueName: \"kubernetes.io/projected/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-kube-api-access-wpt2r\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744314 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744314 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-tls\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744385 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-grpc-tls\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.744385 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.744375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845147 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845147 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845147 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-metrics-client-ca\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845407 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpt2r\" (UniqueName: \"kubernetes.io/projected/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-kube-api-access-wpt2r\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845407 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845407 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-tls\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845551 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-grpc-tls\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845551 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.845902 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.845855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-metrics-client-ca\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.848550 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.848505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.848665 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.848639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.849234 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.849128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-tls\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.849234 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.849160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.849234 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.849193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.849527 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.849508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-secret-grpc-tls\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.855797 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.855765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpt2r\" (UniqueName: \"kubernetes.io/projected/7b7a2ace-1e1d-4e77-a090-c51e860a8ab6-kube-api-access-wpt2r\") pod \"thanos-querier-68d5575578-n9bw2\" (UID: \"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6\") " pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:20.994937 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:20.994886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:21.322384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:21.322353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:23.050902 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.050868    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bc99475cc-mvg89"]
Sep 09 21:19:23.055465 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.054651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.062156 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.062130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 21:19:23.062575 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.062550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 21:19:23.063441 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.063417    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 21:19:23.063554 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.063423    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xmqjb\""
Sep 09 21:19:23.063759 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.063740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cckr3ql6u19sq\""
Sep 09 21:19:23.067870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-secret-metrics-server-tls\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.067870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.067870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-audit-log\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.067870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-client-ca-bundle\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.067870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-secret-metrics-server-client-certs\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.067870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnqm\" (UniqueName: \"kubernetes.io/projected/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-kube-api-access-slnqm\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.068176 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.067895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-metrics-server-audit-profiles\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.069615 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.069597    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 21:19:23.088763 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.088732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bc99475cc-mvg89"]
Sep 09 21:19:23.168352 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-secret-metrics-server-tls\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168511 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168511 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-audit-log\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168511 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-client-ca-bundle\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168678 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-secret-metrics-server-client-certs\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168678 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnqm\" (UniqueName: \"kubernetes.io/projected/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-kube-api-access-slnqm\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168776 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-metrics-server-audit-profiles\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.168828 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.168801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-audit-log\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.169342 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.169257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.170088 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.170043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-metrics-server-audit-profiles\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.171686 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.171663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-client-ca-bundle\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.171790 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.171665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-secret-metrics-server-client-certs\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.172260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.172242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-secret-metrics-server-tls\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.206402 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.206345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnqm\" (UniqueName: \"kubernetes.io/projected/5a78cee9-a6c4-4a2c-8963-b4d73c90129a-kube-api-access-slnqm\") pod \"metrics-server-7bc99475cc-mvg89\" (UID: \"5a78cee9-a6c4-4a2c-8963-b4d73c90129a\") " pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.370552 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.370464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:23.395038 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.394971    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9989dbffc-kdcd5"]
Sep 09 21:19:23.398346 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.398325    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.448538 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.448493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9989dbffc-kdcd5"]
Sep 09 21:19:23.471423 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-oauth-config\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.471423 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-console-config\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.471423 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wsx\" (UniqueName: \"kubernetes.io/projected/738e7a5a-bbb2-44c2-812a-716e4a595563-kube-api-access-k2wsx\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.471423 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-serving-cert\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.471832 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-trusted-ca-bundle\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.471832 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-service-ca\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.471832 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.471572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-oauth-serving-cert\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572464 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-oauth-config\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572643 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-console-config\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572643 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wsx\" (UniqueName: \"kubernetes.io/projected/738e7a5a-bbb2-44c2-812a-716e4a595563-kube-api-access-k2wsx\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572643 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-serving-cert\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572643 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-trusted-ca-bundle\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-service-ca\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.572842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.572695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-oauth-serving-cert\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.574579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.573591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-oauth-serving-cert\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.574579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.573899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-trusted-ca-bundle\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.574579 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.574212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-service-ca\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.574827 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.574598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-console-config\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.575675 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.575632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-oauth-config\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.576190 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.576170    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-serving-cert\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.590876 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.590856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wsx\" (UniqueName: \"kubernetes.io/projected/738e7a5a-bbb2-44c2-812a-716e4a595563-kube-api-access-k2wsx\") pod \"console-9989dbffc-kdcd5\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") " pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:23.709390 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:23.709310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:27.747253 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:27.747179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bc99475cc-mvg89"]
Sep 09 21:19:27.749016 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:27.748990    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9989dbffc-kdcd5"]
Sep 09 21:19:27.750026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:27.750005    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d5575578-n9bw2"]
Sep 09 21:19:27.975353 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:27.975312    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738e7a5a_bbb2_44c2_812a_716e4a595563.slice/crio-3447f3858d52b25bcc4861d70566ae16c4118f38d598541b0e4740ef3ea458e3 WatchSource:0}: Error finding container 3447f3858d52b25bcc4861d70566ae16c4118f38d598541b0e4740ef3ea458e3: Status 404 returned error can't find the container with id 3447f3858d52b25bcc4861d70566ae16c4118f38d598541b0e4740ef3ea458e3
Sep 09 21:19:27.976259 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:27.976223    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7a2ace_1e1d_4e77_a090_c51e860a8ab6.slice/crio-7a5fba9ddfc22609010296726e17a9da2e649e6ddebc3ddbc264bc1374c66937 WatchSource:0}: Error finding container 7a5fba9ddfc22609010296726e17a9da2e649e6ddebc3ddbc264bc1374c66937: Status 404 returned error can't find the container with id 7a5fba9ddfc22609010296726e17a9da2e649e6ddebc3ddbc264bc1374c66937
Sep 09 21:19:27.977137 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:19:27.977062    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a78cee9_a6c4_4a2c_8963_b4d73c90129a.slice/crio-fe4fb85da218e1c4a4fb91db2f6c97dc34d14e37577a0bcd2d7d0ca432051ced WatchSource:0}: Error finding container fe4fb85da218e1c4a4fb91db2f6c97dc34d14e37577a0bcd2d7d0ca432051ced: Status 404 returned error can't find the container with id fe4fb85da218e1c4a4fb91db2f6c97dc34d14e37577a0bcd2d7d0ca432051ced
Sep 09 21:19:28.351338 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.351295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk" event={"ID":"65bfa231-6570-48eb-99ff-723ad77a2cf5","Type":"ContainerStarted","Data":"73c80187903681f2662be4de395077dce2720657e9a08f7a21c4f7f52b0d2761"}
Sep 09 21:19:28.352844 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.352811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"7a5fba9ddfc22609010296726e17a9da2e649e6ddebc3ddbc264bc1374c66937"}
Sep 09 21:19:28.354691 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.354665    2580 generic.go:356] "Generic (PLEG): container finished" podID="f2de1b83-d527-4855-b76a-e762f8e1744b" containerID="50a9741780269ce1f2f5933c7a8a01840022ec20c424b291ed3a4b34d9fd5782" exitCode=0
Sep 09 21:19:28.354818 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.354754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pv9m2" event={"ID":"f2de1b83-d527-4855-b76a-e762f8e1744b","Type":"ContainerDied","Data":"50a9741780269ce1f2f5933c7a8a01840022ec20c424b291ed3a4b34d9fd5782"}
Sep 09 21:19:28.357056 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.357025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-thhcz" event={"ID":"edd1a462-d99e-4b97-b3a6-a28fa975d151","Type":"ContainerStarted","Data":"7ee503b7e3e6e41ca8cfdf4bbcd5b16c77e7761f2ed3675121cf0282e004357d"}
Sep 09 21:19:28.357163 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.357073    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:28.360109 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.360082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9989dbffc-kdcd5" event={"ID":"738e7a5a-bbb2-44c2-812a-716e4a595563","Type":"ContainerStarted","Data":"df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9"}
Sep 09 21:19:28.360219 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.360120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9989dbffc-kdcd5" event={"ID":"738e7a5a-bbb2-44c2-812a-716e4a595563","Type":"ContainerStarted","Data":"3447f3858d52b25bcc4861d70566ae16c4118f38d598541b0e4740ef3ea458e3"}
Sep 09 21:19:28.361430 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.361402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89" event={"ID":"5a78cee9-a6c4-4a2c-8963-b4d73c90129a","Type":"ContainerStarted","Data":"fe4fb85da218e1c4a4fb91db2f6c97dc34d14e37577a0bcd2d7d0ca432051ced"}
Sep 09 21:19:28.370285 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.370264    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-thhcz"
Sep 09 21:19:28.386638 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.386585    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-b5lwk" podStartSLOduration=2.320023888 podStartE2EDuration="10.386562982s" totalImagesPullingTime="8.066539094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:28.385636392 +0000 UTC m=+671.861329385" watchObservedRunningTime="2026-09-09 21:19:28.386562982 +0000 UTC m=+671.862256012"
Sep 09 21:19:28.467490 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.467375    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9989dbffc-kdcd5" podStartSLOduration=5.467355123 podStartE2EDuration="5.467355123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:28.466314349 +0000 UTC m=+671.942007342" watchObservedRunningTime="2026-09-09 21:19:28.467355123 +0000 UTC m=+671.943048308"
Sep 09 21:19:28.527891 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:28.526856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-thhcz" podStartSLOduration=1.935807471 podStartE2EDuration="18.526831544s" totalImagesPullingTime="16.591024073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:28.525575469 +0000 UTC m=+672.001268493" watchObservedRunningTime="2026-09-09 21:19:28.526831544 +0000 UTC m=+672.002524540"
Sep 09 21:19:29.372491 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:29.372454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pv9m2" event={"ID":"f2de1b83-d527-4855-b76a-e762f8e1744b","Type":"ContainerStarted","Data":"eca46383b928f55770c6e9920220642807d67bde121c7e84d01f12af86d4d2d4"}
Sep 09 21:19:29.372996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:29.372513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pv9m2" event={"ID":"f2de1b83-d527-4855-b76a-e762f8e1744b","Type":"ContainerStarted","Data":"ff167b9858362b30c6f2ee20bf3e849838724b7fb439f6e20b1568df99341423"}
Sep 09 21:19:31.676680 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:31.676653    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:19:32.389874 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:32.389822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89" event={"ID":"5a78cee9-a6c4-4a2c-8963-b4d73c90129a","Type":"ContainerStarted","Data":"cc45836d47150707fe09e127a54b6c9ca725dcafd82e6952625c585193cd11fc"}
Sep 09 21:19:32.393824 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:32.393677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"5334c85ab27518c31beef33441f0e9851f6974cea14edf792950e3bbe2e997fd"}
Sep 09 21:19:32.393824 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:32.393745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"7e03768b394bf0a4cd85a5f6a876072bfa63a8bf8f6293c4ce54e6e2abfde2c2"}
Sep 09 21:19:32.393824 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:32.393783    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"c0b0ae2584215508cfe48fdbac039a3459b22b68484f016d0dc6872410a4bae7"}
Sep 09 21:19:32.428859 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:32.428811    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pv9m2" podStartSLOduration=6.507568782 podStartE2EDuration="14.428798599s" totalImagesPullingTime="7.841949654s" totalInitContainerRuntime="79.280163ms" isStatefulPod=true podCreationTimestamp="2026-09-09 21:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:29.425584042 +0000 UTC m=+672.901277065" watchObservedRunningTime="2026-09-09 21:19:32.428798599 +0000 UTC m=+675.904491630"
Sep 09 21:19:33.401553 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.401471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"c96b5b52ff8c3422b4320f7fc62ebf6f0fdb498585251850a527b496fb6b0219"}
Sep 09 21:19:33.402056 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.401553    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"e1aea9a35f3a91fbc208d3ec84177bf832f4ee9851892c5526bd8b152cd327f5"}
Sep 09 21:19:33.402056 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.401599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" event={"ID":"7b7a2ace-1e1d-4e77-a090-c51e860a8ab6","Type":"ContainerStarted","Data":"4c31f74f7c0d98a47af98de95122209d0b490cff8560a561367d05f7de2293ce"}
Sep 09 21:19:33.445269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.445218    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2" podStartSLOduration=9.003118201 podStartE2EDuration="13.445202914s" totalImagesPullingTime="4.442084713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:33.444360645 +0000 UTC m=+676.920053652" watchObservedRunningTime="2026-09-09 21:19:33.445202914 +0000 UTC m=+676.920895907"
Sep 09 21:19:33.445717 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.445691    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89" podStartSLOduration=7.162070571 podStartE2EDuration="10.445684289s" totalImagesPullingTime="3.283613718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:19:32.429591977 +0000 UTC m=+675.905284981" watchObservedRunningTime="2026-09-09 21:19:33.445684289 +0000 UTC m=+676.921377282"
Sep 09 21:19:33.709995 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.709906    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:33.709995 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.709985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:33.715511 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:33.715488    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:34.406015 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:34.405984    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:34.409887 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:34.409861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:19:34.532668 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:34.532637    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8565cf9fbd-q8s26"]
Sep 09 21:19:40.416563 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:40.416539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68d5575578-n9bw2"
Sep 09 21:19:43.370696 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:43.370662    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:43.371048 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:43.370723    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:19:59.554782 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.554733    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8565cf9fbd-q8s26" podUID="c8d2e0d0-c386-4cd6-9621-67996aea0ce2" containerName="console" containerID="cri-o://e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848" gracePeriod=15
Sep 09 21:19:59.821106 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.821052    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:19:59.965015 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.964985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-trusted-ca-bundle\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965157 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965026    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-oauth-serving-cert\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965157 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965067    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f24n8\" (UniqueName: \"kubernetes.io/projected/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-kube-api-access-f24n8\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965264 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-service-ca\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965264 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-serving-cert\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965360 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-config\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965360 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-oauth-config\") pod \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\" (UID: \"c8d2e0d0-c386-4cd6-9621-67996aea0ce2\") "
Sep 09 21:19:59.965476 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:59.965476 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965450    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:59.965567 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:59.965662 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965643    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-service-ca\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:59.965888 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965668    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-trusted-ca-bundle\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:59.965888 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965683    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-oauth-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:19:59.965888 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.965719    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-config" (OuterVolumeSpecName: "console-config") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:19:59.967470 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.967444    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:19:59.967565 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.967472    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:19:59.967565 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:19:59.967496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-kube-api-access-f24n8" (OuterVolumeSpecName: "kube-api-access-f24n8") pod "c8d2e0d0-c386-4cd6-9621-67996aea0ce2" (UID: "c8d2e0d0-c386-4cd6-9621-67996aea0ce2"). InnerVolumeSpecName "kube-api-access-f24n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:20:00.066117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.066096    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f24n8\" (UniqueName: \"kubernetes.io/projected/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-kube-api-access-f24n8\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:20:00.066117 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.066114    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:20:00.066233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.066123    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:20:00.066233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.066131    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8d2e0d0-c386-4cd6-9621-67996aea0ce2-console-oauth-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:20:00.500002 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.499978    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8d2e0d0-c386-4cd6-9621-67996aea0ce2" containerID="e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848" exitCode=0
Sep 09 21:20:00.500094 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.500017    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8565cf9fbd-q8s26"
Sep 09 21:20:00.500094 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.500056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565cf9fbd-q8s26" event={"ID":"c8d2e0d0-c386-4cd6-9621-67996aea0ce2","Type":"ContainerDied","Data":"e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848"}
Sep 09 21:20:00.500094 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.500090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8565cf9fbd-q8s26" event={"ID":"c8d2e0d0-c386-4cd6-9621-67996aea0ce2","Type":"ContainerDied","Data":"0c393d5a49a5230c4f92d88a4bd4a02fc6931f30dde307782490505e8286c452"}
Sep 09 21:20:00.500190 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.500108    2580 scope.go:117] "RemoveContainer" containerID="e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848"
Sep 09 21:20:00.508088 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.508069    2580 scope.go:117] "RemoveContainer" containerID="e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848"
Sep 09 21:20:00.508359 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:20:00.508340    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848\": container with ID starting with e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848 not found: ID does not exist" containerID="e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848"
Sep 09 21:20:00.508419 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.508370    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848"} err="failed to get container status \"e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848\": rpc error: code = NotFound desc = could not find container \"e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848\": container with ID starting with e24974e3e5fee5c1992dd8ac06e240cbd59972da203f7a15129f7bd56ce64848 not found: ID does not exist"
Sep 09 21:20:00.530459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.530438    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8565cf9fbd-q8s26"]
Sep 09 21:20:00.540672 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:00.540648    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8565cf9fbd-q8s26"]
Sep 09 21:20:01.029676 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:01.029651    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8d2e0d0-c386-4cd6-9621-67996aea0ce2" path="/var/lib/kubelet/pods/c8d2e0d0-c386-4cd6-9621-67996aea0ce2/volumes"
Sep 09 21:20:03.376025 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:03.376002    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:20:03.379486 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:03.379466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bc99475cc-mvg89"
Sep 09 21:20:46.045951 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.045906    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8486849dd9-qbvq6"]
Sep 09 21:20:46.046379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.046200    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d2e0d0-c386-4cd6-9621-67996aea0ce2" containerName="console"
Sep 09 21:20:46.046379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.046212    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d2e0d0-c386-4cd6-9621-67996aea0ce2" containerName="console"
Sep 09 21:20:46.046379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.046268    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d2e0d0-c386-4cd6-9621-67996aea0ce2" containerName="console"
Sep 09 21:20:46.048269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.048254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.075460 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.075441    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8486849dd9-qbvq6"]
Sep 09 21:20:46.093349 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-console-config\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.093457 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-oauth-config\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.093457 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-oauth-serving-cert\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.093547 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz82q\" (UniqueName: \"kubernetes.io/projected/d626007f-540e-41ff-b36c-6020f182be2e-kube-api-access-mz82q\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.093547 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-trusted-ca-bundle\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.093547 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-service-ca\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.093639 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.093552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-serving-cert\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.194857 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.194829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-console-config\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195006 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.194873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-oauth-config\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195006 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.194904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-oauth-serving-cert\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195006 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.194960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz82q\" (UniqueName: \"kubernetes.io/projected/d626007f-540e-41ff-b36c-6020f182be2e-kube-api-access-mz82q\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195006 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.194986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-trusted-ca-bundle\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195216 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.195014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-service-ca\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195216 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.195041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-serving-cert\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195647 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.195620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-console-config\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195756 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.195634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-oauth-serving-cert\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.195756 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.195729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-service-ca\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.196169 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.196146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-trusted-ca-bundle\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.197317 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.197292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-oauth-config\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.197464 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.197448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-serving-cert\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.212780 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.212760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz82q\" (UniqueName: \"kubernetes.io/projected/d626007f-540e-41ff-b36c-6020f182be2e-kube-api-access-mz82q\") pod \"console-8486849dd9-qbvq6\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") " pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.357223 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.357151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:46.651392 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.651370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8486849dd9-qbvq6"]
Sep 09 21:20:46.653867 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:20:46.653839    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd626007f_540e_41ff_b36c_6020f182be2e.slice/crio-53560d195933cb1eca30eac34677a1a1637fc5ceb3a91bdbd53b0e31805543c2 WatchSource:0}: Error finding container 53560d195933cb1eca30eac34677a1a1637fc5ceb3a91bdbd53b0e31805543c2: Status 404 returned error can't find the container with id 53560d195933cb1eca30eac34677a1a1637fc5ceb3a91bdbd53b0e31805543c2
Sep 09 21:20:46.662530 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:46.662497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486849dd9-qbvq6" event={"ID":"d626007f-540e-41ff-b36c-6020f182be2e","Type":"ContainerStarted","Data":"53560d195933cb1eca30eac34677a1a1637fc5ceb3a91bdbd53b0e31805543c2"}
Sep 09 21:20:47.668189 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:47.668142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486849dd9-qbvq6" event={"ID":"d626007f-540e-41ff-b36c-6020f182be2e","Type":"ContainerStarted","Data":"b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2"}
Sep 09 21:20:47.719760 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:47.719720    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8486849dd9-qbvq6" podStartSLOduration=1.7197059019999998 podStartE2EDuration="1.719705902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:20:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:20:47.717296489 +0000 UTC m=+751.192989483" watchObservedRunningTime="2026-09-09 21:20:47.719705902 +0000 UTC m=+751.195398894"
Sep 09 21:20:56.357551 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:56.357519    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:56.357998 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:56.357580    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:56.362001 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:56.361976    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:56.703605 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:56.703540    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:20:56.844842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:56.844815    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9989dbffc-kdcd5"]
Sep 09 21:20:57.124926 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.124857    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bdb4b46c8-5ngwh"]
Sep 09 21:20:57.127207 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.127185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.153733 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.153713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdb4b46c8-5ngwh"]
Sep 09 21:20:57.167416 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-serving-cert\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.167500 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-oauth-serving-cert\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.167500 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-config\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.167500 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-trusted-ca-bundle\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.167500 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjdff\" (UniqueName: \"kubernetes.io/projected/5598cb0a-8e2c-4361-bbff-dacd7385e19e-kube-api-access-vjdff\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.167625 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-oauth-config\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.167625 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.167603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-service-ca\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.268867 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.268778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-trusted-ca-bundle\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.268974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.268890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjdff\" (UniqueName: \"kubernetes.io/projected/5598cb0a-8e2c-4361-bbff-dacd7385e19e-kube-api-access-vjdff\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.268974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.268907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-oauth-config\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.268974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.268950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-service-ca\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269184 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-serving-cert\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269184 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-oauth-serving-cert\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269184 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-config\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269673 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-config\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269763 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-oauth-serving-cert\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269763 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-trusted-ca-bundle\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.269838 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.269722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-service-ca\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.271338 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.271322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-oauth-config\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.271479 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.271461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-serving-cert\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.279832 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.279808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjdff\" (UniqueName: \"kubernetes.io/projected/5598cb0a-8e2c-4361-bbff-dacd7385e19e-kube-api-access-vjdff\") pod \"console-7bdb4b46c8-5ngwh\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") " pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.436130 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.436074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:20:57.730699 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:57.730638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdb4b46c8-5ngwh"]
Sep 09 21:20:57.733470 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:20:57.733447    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5598cb0a_8e2c_4361_bbff_dacd7385e19e.slice/crio-c1981c76838e77f328420d2927cc65e7fd8bc0aaba3621063743047b65a3141e WatchSource:0}: Error finding container c1981c76838e77f328420d2927cc65e7fd8bc0aaba3621063743047b65a3141e: Status 404 returned error can't find the container with id c1981c76838e77f328420d2927cc65e7fd8bc0aaba3621063743047b65a3141e
Sep 09 21:20:58.708083 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:58.708048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb4b46c8-5ngwh" event={"ID":"5598cb0a-8e2c-4361-bbff-dacd7385e19e","Type":"ContainerStarted","Data":"a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3"}
Sep 09 21:20:58.708407 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:58.708092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb4b46c8-5ngwh" event={"ID":"5598cb0a-8e2c-4361-bbff-dacd7385e19e","Type":"ContainerStarted","Data":"c1981c76838e77f328420d2927cc65e7fd8bc0aaba3621063743047b65a3141e"}
Sep 09 21:20:58.729771 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:20:58.729728    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bdb4b46c8-5ngwh" podStartSLOduration=1.729714462 podStartE2EDuration="1.729714462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:20:58.728636069 +0000 UTC m=+762.204329073" watchObservedRunningTime="2026-09-09 21:20:58.729714462 +0000 UTC m=+762.205407455"
Sep 09 21:21:07.437251 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:07.437223    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:21:07.437585 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:07.437291    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:21:07.441508 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:07.441487    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:21:07.743624 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:07.743568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:21:07.814511 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:07.814482    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8486849dd9-qbvq6"]
Sep 09 21:21:21.863932 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:21.863865    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9989dbffc-kdcd5" podUID="738e7a5a-bbb2-44c2-812a-716e4a595563" containerName="console" containerID="cri-o://df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9" gracePeriod=15
Sep 09 21:21:22.104453 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.104432    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:21:22.247040 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.246987    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-oauth-config\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247040 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2wsx\" (UniqueName: \"kubernetes.io/projected/738e7a5a-bbb2-44c2-812a-716e4a595563-kube-api-access-k2wsx\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247226 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247046    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-console-config\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247226 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-serving-cert\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247226 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247087    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-service-ca\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247226 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-oauth-serving-cert\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247226 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247137    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-trusted-ca-bundle\") pod \"738e7a5a-bbb2-44c2-812a-716e4a595563\" (UID: \"738e7a5a-bbb2-44c2-812a-716e4a595563\") "
Sep 09 21:21:22.247512 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247481    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-console-config" (OuterVolumeSpecName: "console-config") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:22.247603 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247503    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-service-ca" (OuterVolumeSpecName: "service-ca") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:22.247603 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247589    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:22.247709 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.247693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:22.249168 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.249141    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738e7a5a-bbb2-44c2-812a-716e4a595563-kube-api-access-k2wsx" (OuterVolumeSpecName: "kube-api-access-k2wsx") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "kube-api-access-k2wsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:21:22.249699 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.249676    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:21:22.249770 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.249693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "738e7a5a-bbb2-44c2-812a-716e4a595563" (UID: "738e7a5a-bbb2-44c2-812a-716e4a595563"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:21:22.348154 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348132    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-oauth-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.348154 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348150    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-trusted-ca-bundle\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.348260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348160    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-oauth-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.348260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348169    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2wsx\" (UniqueName: \"kubernetes.io/projected/738e7a5a-bbb2-44c2-812a-716e4a595563-kube-api-access-k2wsx\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.348260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348177    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-console-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.348260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348184    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/738e7a5a-bbb2-44c2-812a-716e4a595563-console-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.348260 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.348192    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/738e7a5a-bbb2-44c2-812a-716e4a595563-service-ca\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:22.794837 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.794812    2580 generic.go:356] "Generic (PLEG): container finished" podID="738e7a5a-bbb2-44c2-812a-716e4a595563" containerID="df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9" exitCode=0
Sep 09 21:21:22.794952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.794856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9989dbffc-kdcd5"
Sep 09 21:21:22.794952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.794887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9989dbffc-kdcd5" event={"ID":"738e7a5a-bbb2-44c2-812a-716e4a595563","Type":"ContainerDied","Data":"df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9"}
Sep 09 21:21:22.794952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.794946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9989dbffc-kdcd5" event={"ID":"738e7a5a-bbb2-44c2-812a-716e4a595563","Type":"ContainerDied","Data":"3447f3858d52b25bcc4861d70566ae16c4118f38d598541b0e4740ef3ea458e3"}
Sep 09 21:21:22.795111 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.794966    2580 scope.go:117] "RemoveContainer" containerID="df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9"
Sep 09 21:21:22.803256 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.803237    2580 scope.go:117] "RemoveContainer" containerID="df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9"
Sep 09 21:21:22.803524 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:21:22.803508    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9\": container with ID starting with df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9 not found: ID does not exist" containerID="df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9"
Sep 09 21:21:22.803588 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.803534    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9"} err="failed to get container status \"df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9\": rpc error: code = NotFound desc = could not find container \"df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9\": container with ID starting with df51685cea32f95381a8fd33d5fc3b6156bb60afabc3db0d43f8842715e1c3d9 not found: ID does not exist"
Sep 09 21:21:22.818813 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.818784    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9989dbffc-kdcd5"]
Sep 09 21:21:22.825618 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:22.823604    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9989dbffc-kdcd5"]
Sep 09 21:21:23.030573 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:23.030550    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="738e7a5a-bbb2-44c2-812a-716e4a595563" path="/var/lib/kubelet/pods/738e7a5a-bbb2-44c2-812a-716e4a595563/volumes"
Sep 09 21:21:32.835580 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:32.835523    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8486849dd9-qbvq6" podUID="d626007f-540e-41ff-b36c-6020f182be2e" containerName="console" containerID="cri-o://b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2" gracePeriod=15
Sep 09 21:21:33.073590 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.073567    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:21:33.227268 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-oauth-serving-cert\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227268 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227259    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-trusted-ca-bundle\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz82q\" (UniqueName: \"kubernetes.io/projected/d626007f-540e-41ff-b36c-6020f182be2e-kube-api-access-mz82q\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-oauth-config\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-service-ca\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227428 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-serving-cert\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227616 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-console-config\") pod \"d626007f-540e-41ff-b36c-6020f182be2e\" (UID: \"d626007f-540e-41ff-b36c-6020f182be2e\") "
Sep 09 21:21:33.227670 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:33.227758 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227700    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-service-ca" (OuterVolumeSpecName: "service-ca") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:33.227758 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227715    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:33.227960 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.227904    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-console-config" (OuterVolumeSpecName: "console-config") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:21:33.229828 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.229804    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:21:33.230150 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.230135    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d626007f-540e-41ff-b36c-6020f182be2e-kube-api-access-mz82q" (OuterVolumeSpecName: "kube-api-access-mz82q") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "kube-api-access-mz82q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:21:33.230235 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.230147    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d626007f-540e-41ff-b36c-6020f182be2e" (UID: "d626007f-540e-41ff-b36c-6020f182be2e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:21:33.328609 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328592    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-service-ca\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.328609 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328610    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.328716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328618    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-console-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.328716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328627    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-oauth-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.328716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328634    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d626007f-540e-41ff-b36c-6020f182be2e-trusted-ca-bundle\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.328716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328642    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz82q\" (UniqueName: \"kubernetes.io/projected/d626007f-540e-41ff-b36c-6020f182be2e-kube-api-access-mz82q\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.328716 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.328649    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d626007f-540e-41ff-b36c-6020f182be2e-console-oauth-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:21:33.837931 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.837889    2580 generic.go:356] "Generic (PLEG): container finished" podID="d626007f-540e-41ff-b36c-6020f182be2e" containerID="b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2" exitCode=0
Sep 09 21:21:33.838232 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.837952    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8486849dd9-qbvq6"
Sep 09 21:21:33.838232 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.837949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486849dd9-qbvq6" event={"ID":"d626007f-540e-41ff-b36c-6020f182be2e","Type":"ContainerDied","Data":"b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2"}
Sep 09 21:21:33.838232 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.838061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8486849dd9-qbvq6" event={"ID":"d626007f-540e-41ff-b36c-6020f182be2e","Type":"ContainerDied","Data":"53560d195933cb1eca30eac34677a1a1637fc5ceb3a91bdbd53b0e31805543c2"}
Sep 09 21:21:33.838232 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.838081    2580 scope.go:117] "RemoveContainer" containerID="b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2"
Sep 09 21:21:33.846405 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.846390    2580 scope.go:117] "RemoveContainer" containerID="b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2"
Sep 09 21:21:33.846657 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:21:33.846640    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2\": container with ID starting with b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2 not found: ID does not exist" containerID="b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2"
Sep 09 21:21:33.846697 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.846665    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2"} err="failed to get container status \"b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2\": rpc error: code = NotFound desc = could not find container \"b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2\": container with ID starting with b1b35d829986aeaff5009625d29ba28b8ca94e10160fc77b63a2b5813052d9d2 not found: ID does not exist"
Sep 09 21:21:33.861544 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.861522    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8486849dd9-qbvq6"]
Sep 09 21:21:33.870272 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:33.870249    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8486849dd9-qbvq6"]
Sep 09 21:21:35.029971 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:21:35.029946    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d626007f-540e-41ff-b36c-6020f182be2e" path="/var/lib/kubelet/pods/d626007f-540e-41ff-b36c-6020f182be2e/volumes"
Sep 09 21:22:49.897029 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.896997    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dtgj4"]
Sep 09 21:22:49.897459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.897319    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d626007f-540e-41ff-b36c-6020f182be2e" containerName="console"
Sep 09 21:22:49.897459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.897331    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d626007f-540e-41ff-b36c-6020f182be2e" containerName="console"
Sep 09 21:22:49.897459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.897340    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="738e7a5a-bbb2-44c2-812a-716e4a595563" containerName="console"
Sep 09 21:22:49.897459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.897346    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="738e7a5a-bbb2-44c2-812a-716e4a595563" containerName="console"
Sep 09 21:22:49.897459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.897413    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="738e7a5a-bbb2-44c2-812a-716e4a595563" containerName="console"
Sep 09 21:22:49.897459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.897422    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d626007f-540e-41ff-b36c-6020f182be2e" containerName="console"
Sep 09 21:22:49.899225 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.899201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:49.921828 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.921809    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 21:22:49.925523 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.925502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 21:22:49.950454 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.950430    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dtgj4"]
Sep 09 21:22:49.968460 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.968441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgbcr\" (UniqueName: \"kubernetes.io/projected/e98eef67-fd48-4ac4-9423-61e8be93c05a-kube-api-access-fgbcr\") pod \"cert-manager-webhook-6486ffd997-dtgj4\" (UID: \"e98eef67-fd48-4ac4-9423-61e8be93c05a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:49.968550 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:49.968489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e98eef67-fd48-4ac4-9423-61e8be93c05a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dtgj4\" (UID: \"e98eef67-fd48-4ac4-9423-61e8be93c05a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:50.069815 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:50.069778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgbcr\" (UniqueName: \"kubernetes.io/projected/e98eef67-fd48-4ac4-9423-61e8be93c05a-kube-api-access-fgbcr\") pod \"cert-manager-webhook-6486ffd997-dtgj4\" (UID: \"e98eef67-fd48-4ac4-9423-61e8be93c05a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:50.069964 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:50.069844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e98eef67-fd48-4ac4-9423-61e8be93c05a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dtgj4\" (UID: \"e98eef67-fd48-4ac4-9423-61e8be93c05a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:50.085823 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:50.085795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgbcr\" (UniqueName: \"kubernetes.io/projected/e98eef67-fd48-4ac4-9423-61e8be93c05a-kube-api-access-fgbcr\") pod \"cert-manager-webhook-6486ffd997-dtgj4\" (UID: \"e98eef67-fd48-4ac4-9423-61e8be93c05a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:50.086256 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:50.086239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e98eef67-fd48-4ac4-9423-61e8be93c05a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dtgj4\" (UID: \"e98eef67-fd48-4ac4-9423-61e8be93c05a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:50.228475 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:50.228416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:50.513383 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:50.513358    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dtgj4"]
Sep 09 21:22:50.516474 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:22:50.516452    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode98eef67_fd48_4ac4_9423_61e8be93c05a.slice/crio-4e721b83b89919c44e8eb97683ad1f1881b8137fbe23f2c4b7907beb20296810 WatchSource:0}: Error finding container 4e721b83b89919c44e8eb97683ad1f1881b8137fbe23f2c4b7907beb20296810: Status 404 returned error can't find the container with id 4e721b83b89919c44e8eb97683ad1f1881b8137fbe23f2c4b7907beb20296810
Sep 09 21:22:51.123503 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:51.123467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4" event={"ID":"e98eef67-fd48-4ac4-9423-61e8be93c05a","Type":"ContainerStarted","Data":"4e721b83b89919c44e8eb97683ad1f1881b8137fbe23f2c4b7907beb20296810"}
Sep 09 21:22:54.138874 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:54.138839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4" event={"ID":"e98eef67-fd48-4ac4-9423-61e8be93c05a","Type":"ContainerStarted","Data":"2f15a658541087599f4edd2a8fa22b546ac2606a07aafe682aac9a215c067b5f"}
Sep 09 21:22:54.139240 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:54.138887    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:22:54.159673 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:22:54.159634    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4" podStartSLOduration=2.034011349 podStartE2EDuration="5.159620634s" totalImagesPullingTime="3.125609285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:22:54.158026196 +0000 UTC m=+877.633719203" watchObservedRunningTime="2026-09-09 21:22:54.159620634 +0000 UTC m=+877.635313630"
Sep 09 21:23:00.144608 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:00.144579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dtgj4"
Sep 09 21:23:01.362612 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.362581    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k2dvr"]
Sep 09 21:23:01.364809 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.364789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.367771 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.367753    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bgn27\""
Sep 09 21:23:01.384197 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.384177    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k2dvr"]
Sep 09 21:23:01.457208 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.457189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f381bb5-c5da-4b57-976e-d354c01af14a-bound-sa-token\") pod \"cert-manager-55b4d954d5-k2dvr\" (UID: \"9f381bb5-c5da-4b57-976e-d354c01af14a\") " pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.457300 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.457230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5722\" (UniqueName: \"kubernetes.io/projected/9f381bb5-c5da-4b57-976e-d354c01af14a-kube-api-access-s5722\") pod \"cert-manager-55b4d954d5-k2dvr\" (UID: \"9f381bb5-c5da-4b57-976e-d354c01af14a\") " pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.557698 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.557673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f381bb5-c5da-4b57-976e-d354c01af14a-bound-sa-token\") pod \"cert-manager-55b4d954d5-k2dvr\" (UID: \"9f381bb5-c5da-4b57-976e-d354c01af14a\") " pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.557794 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.557716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5722\" (UniqueName: \"kubernetes.io/projected/9f381bb5-c5da-4b57-976e-d354c01af14a-kube-api-access-s5722\") pod \"cert-manager-55b4d954d5-k2dvr\" (UID: \"9f381bb5-c5da-4b57-976e-d354c01af14a\") " pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.567668 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.567649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f381bb5-c5da-4b57-976e-d354c01af14a-bound-sa-token\") pod \"cert-manager-55b4d954d5-k2dvr\" (UID: \"9f381bb5-c5da-4b57-976e-d354c01af14a\") " pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.567780 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.567706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5722\" (UniqueName: \"kubernetes.io/projected/9f381bb5-c5da-4b57-976e-d354c01af14a-kube-api-access-s5722\") pod \"cert-manager-55b4d954d5-k2dvr\" (UID: \"9f381bb5-c5da-4b57-976e-d354c01af14a\") " pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.695508 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.695459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k2dvr"
Sep 09 21:23:01.974997 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:01.974936    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k2dvr"]
Sep 09 21:23:01.977796 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:23:01.977776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f381bb5_c5da_4b57_976e_d354c01af14a.slice/crio-f348dfa1a81bece51d89cc48aee332e737214eb4ef87f2c9e092fc017f06a014 WatchSource:0}: Error finding container f348dfa1a81bece51d89cc48aee332e737214eb4ef87f2c9e092fc017f06a014: Status 404 returned error can't find the container with id f348dfa1a81bece51d89cc48aee332e737214eb4ef87f2c9e092fc017f06a014
Sep 09 21:23:02.170714 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:02.170682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k2dvr" event={"ID":"9f381bb5-c5da-4b57-976e-d354c01af14a","Type":"ContainerStarted","Data":"8edd569acd363679081b236ab39703f1825231d0210c19ac00d28434b9001e8e"}
Sep 09 21:23:02.170844 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:02.170723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k2dvr" event={"ID":"9f381bb5-c5da-4b57-976e-d354c01af14a","Type":"ContainerStarted","Data":"f348dfa1a81bece51d89cc48aee332e737214eb4ef87f2c9e092fc017f06a014"}
Sep 09 21:23:02.194530 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:02.194490    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-k2dvr" podStartSLOduration=1.19447533 podStartE2EDuration="1.19447533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:02.19361362 +0000 UTC m=+885.669306614" watchObservedRunningTime="2026-09-09 21:23:02.19447533 +0000 UTC m=+885.670168323"
Sep 09 21:23:16.941384 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:16.941307    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:23:16.941754 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:16.941691    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:23:23.594566 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.594532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"]
Sep 09 21:23:23.602042 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.602016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.606548 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.606528    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 21:23:23.607075 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.607054    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 21:23:23.607217 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.607093    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 21:23:23.607559 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.607541    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z4nj8\""
Sep 09 21:23:23.608379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.608096    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 21:23:23.635526 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.635508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"]
Sep 09 21:23:23.727184 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.727160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1d090e4-9652-4cda-9fab-de7ec028b0b6-manifests\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.727298 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.727188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr9wp\" (UniqueName: \"kubernetes.io/projected/c1d090e4-9652-4cda-9fab-de7ec028b0b6-kube-api-access-dr9wp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.727298 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.727221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1d090e4-9652-4cda-9fab-de7ec028b0b6-tmp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.727413 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.727326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1d090e4-9652-4cda-9fab-de7ec028b0b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.727413 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.727361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1d090e4-9652-4cda-9fab-de7ec028b0b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.828552 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.828526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1d090e4-9652-4cda-9fab-de7ec028b0b6-tmp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.828632 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.828560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1d090e4-9652-4cda-9fab-de7ec028b0b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.828632 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.828583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1d090e4-9652-4cda-9fab-de7ec028b0b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.828700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.828627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1d090e4-9652-4cda-9fab-de7ec028b0b6-manifests\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.828700 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.828676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr9wp\" (UniqueName: \"kubernetes.io/projected/c1d090e4-9652-4cda-9fab-de7ec028b0b6-kube-api-access-dr9wp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.829042 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.829012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1d090e4-9652-4cda-9fab-de7ec028b0b6-manifests\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.830829 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.830806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1d090e4-9652-4cda-9fab-de7ec028b0b6-tmp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.830959 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.830942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1d090e4-9652-4cda-9fab-de7ec028b0b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.831065 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.831048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1d090e4-9652-4cda-9fab-de7ec028b0b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.854039 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.853982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr9wp\" (UniqueName: \"kubernetes.io/projected/c1d090e4-9652-4cda-9fab-de7ec028b0b6-kube-api-access-dr9wp\") pod \"opendatahub-operator-controller-manager-79ffd8f657-l8r85\" (UID: \"c1d090e4-9652-4cda-9fab-de7ec028b0b6\") " pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:23.911473 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:23.911449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:24.212674 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:24.212652    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"]
Sep 09 21:23:24.214831 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:23:24.214806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d090e4_9652_4cda_9fab_de7ec028b0b6.slice/crio-4df1223a442d614fb538de11c154b2ba726490143d468ad6b934e878df61acf6 WatchSource:0}: Error finding container 4df1223a442d614fb538de11c154b2ba726490143d468ad6b934e878df61acf6: Status 404 returned error can't find the container with id 4df1223a442d614fb538de11c154b2ba726490143d468ad6b934e878df61acf6
Sep 09 21:23:24.255181 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:24.255143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85" event={"ID":"c1d090e4-9652-4cda-9fab-de7ec028b0b6","Type":"ContainerStarted","Data":"4df1223a442d614fb538de11c154b2ba726490143d468ad6b934e878df61acf6"}
Sep 09 21:23:28.273900 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:28.273870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85" event={"ID":"c1d090e4-9652-4cda-9fab-de7ec028b0b6","Type":"ContainerStarted","Data":"fa55e739ef5a890d0da41c1d12a07bdbfb9f254b0cd8df14c6425986655faf87"}
Sep 09 21:23:29.279161 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:29.279129    2580 generic.go:356] "Generic (PLEG): container finished" podID="c1d090e4-9652-4cda-9fab-de7ec028b0b6" containerID="fa55e739ef5a890d0da41c1d12a07bdbfb9f254b0cd8df14c6425986655faf87" exitCode=0
Sep 09 21:23:29.279502 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:29.279216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85" event={"ID":"c1d090e4-9652-4cda-9fab-de7ec028b0b6","Type":"ContainerDied","Data":"fa55e739ef5a890d0da41c1d12a07bdbfb9f254b0cd8df14c6425986655faf87"}
Sep 09 21:23:30.284994 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:30.284962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85" event={"ID":"c1d090e4-9652-4cda-9fab-de7ec028b0b6","Type":"ContainerStarted","Data":"682880627d22b09da9a0636360b0925d80dab78386a144eca21facc13a248249"}
Sep 09 21:23:30.285328 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:30.285095    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:30.316517 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:30.316474    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85" podStartSLOduration=2.752360383 podStartE2EDuration="7.316461071s" totalImagesPullingTime="3.677944691s" totalInitContainerRuntime="886.155997ms" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:30.313897564 +0000 UTC m=+913.789590558" watchObservedRunningTime="2026-09-09 21:23:30.316461071 +0000 UTC m=+913.792154065"
Sep 09 21:23:41.291047 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.291010    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79ffd8f657-l8r85"
Sep 09 21:23:41.349739 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.349705    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"]
Sep 09 21:23:41.358621 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.358600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.362252 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.362228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 21:23:41.362381 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.362228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 21:23:41.362576 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.362560    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 21:23:41.362772 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.362748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 21:23:41.363110 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.363096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qdxhc\""
Sep 09 21:23:41.363194 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.363180    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 21:23:41.383248 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.383216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"]
Sep 09 21:23:41.452358 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.452326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b33325c7-5f5d-4494-a58f-364691635ad8-cert\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.452459 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.452379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b33325c7-5f5d-4494-a58f-364691635ad8-metrics-cert\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.452523 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.452470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smhz\" (UniqueName: \"kubernetes.io/projected/b33325c7-5f5d-4494-a58f-364691635ad8-kube-api-access-4smhz\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.452591 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.452569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b33325c7-5f5d-4494-a58f-364691635ad8-manager-config\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.553859 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.553805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b33325c7-5f5d-4494-a58f-364691635ad8-cert\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.553859 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.553845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b33325c7-5f5d-4494-a58f-364691635ad8-metrics-cert\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.554008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.553870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smhz\" (UniqueName: \"kubernetes.io/projected/b33325c7-5f5d-4494-a58f-364691635ad8-kube-api-access-4smhz\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.554008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.553892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b33325c7-5f5d-4494-a58f-364691635ad8-manager-config\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.554488 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.554429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b33325c7-5f5d-4494-a58f-364691635ad8-manager-config\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.556200 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.556178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b33325c7-5f5d-4494-a58f-364691635ad8-cert\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.556292 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.556259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b33325c7-5f5d-4494-a58f-364691635ad8-metrics-cert\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.564410 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.564391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smhz\" (UniqueName: \"kubernetes.io/projected/b33325c7-5f5d-4494-a58f-364691635ad8-kube-api-access-4smhz\") pod \"lws-controller-manager-56b8fc5c8c-bwcw6\" (UID: \"b33325c7-5f5d-4494-a58f-364691635ad8\") " pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.668650 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.668625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:41.964414 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:41.964338    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"]
Sep 09 21:23:41.967831 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:23:41.967806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33325c7_5f5d_4494_a58f_364691635ad8.slice/crio-879863b8977530f5311ba6469eb89fb602a8edfd31c708631a8fae93833210c0 WatchSource:0}: Error finding container 879863b8977530f5311ba6469eb89fb602a8edfd31c708631a8fae93833210c0: Status 404 returned error can't find the container with id 879863b8977530f5311ba6469eb89fb602a8edfd31c708631a8fae93833210c0
Sep 09 21:23:42.330850 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:42.330820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6" event={"ID":"b33325c7-5f5d-4494-a58f-364691635ad8","Type":"ContainerStarted","Data":"879863b8977530f5311ba6469eb89fb602a8edfd31c708631a8fae93833210c0"}
Sep 09 21:23:45.346529 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:45.346497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6" event={"ID":"b33325c7-5f5d-4494-a58f-364691635ad8","Type":"ContainerStarted","Data":"d04af47f8f544743560a7387799c15f6ecab85f7a01cfcde42ed3a3b12123043"}
Sep 09 21:23:45.346863 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:45.346717    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:45.382103 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:45.382043    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6" podStartSLOduration=1.802028402 podStartE2EDuration="4.382032286s" totalImagesPullingTime="2.580003884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:45.381090233 +0000 UTC m=+928.856783246" watchObservedRunningTime="2026-09-09 21:23:45.382032286 +0000 UTC m=+928.857725341"
Sep 09 21:23:54.498570 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.498535    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c65cc4f5-2nxf2"]
Sep 09 21:23:54.507929 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.507885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.515461 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.515364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c65cc4f5-2nxf2"]
Sep 09 21:23:54.594898 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.594875    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6679dddbff-v668w"]
Sep 09 21:23:54.598514 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.598498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.602793 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.602767    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-48kjf\""
Sep 09 21:23:54.602939 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.602777    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 21:23:54.603199 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.603163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 21:23:54.612906 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.612885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6679dddbff-v668w"]
Sep 09 21:23:54.645780 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.645759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-oauth-config\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.645885 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.645792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8l7g\" (UniqueName: \"kubernetes.io/projected/6636cbd4-3bb1-47ae-8462-88e87430ee89-kube-api-access-h8l7g\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.645885 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.645820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-trusted-ca-bundle\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.646044 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.645886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-oauth-serving-cert\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.646044 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.645932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-serving-cert\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.646044 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.645978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-config\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.646044 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.646004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-service-ca\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.746882 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.746857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16b6a9a-b4ba-4d77-82b3-2352b861281d-tmp\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.746996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.746907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-config\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.746996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.746966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2td96\" (UniqueName: \"kubernetes.io/projected/d16b6a9a-b4ba-4d77-82b3-2352b861281d-kube-api-access-2td96\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.746996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.746992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-service-ca\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747140 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-oauth-config\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747140 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8l7g\" (UniqueName: \"kubernetes.io/projected/6636cbd4-3bb1-47ae-8462-88e87430ee89-kube-api-access-h8l7g\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747245 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-trusted-ca-bundle\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747245 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16b6a9a-b4ba-4d77-82b3-2352b861281d-tls-certs\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.747245 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-oauth-serving-cert\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747245 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-serving-cert\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747664 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-service-ca\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.747843 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.747716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-config\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.748118 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.748095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-oauth-serving-cert\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.748421 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.748396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6636cbd4-3bb1-47ae-8462-88e87430ee89-trusted-ca-bundle\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.749713 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.749668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-oauth-config\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.749862 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.749842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6636cbd4-3bb1-47ae-8462-88e87430ee89-console-serving-cert\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.758842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.758819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8l7g\" (UniqueName: \"kubernetes.io/projected/6636cbd4-3bb1-47ae-8462-88e87430ee89-kube-api-access-h8l7g\") pod \"console-54c65cc4f5-2nxf2\" (UID: \"6636cbd4-3bb1-47ae-8462-88e87430ee89\") " pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.819982 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.819957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:23:54.848211 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.848188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16b6a9a-b4ba-4d77-82b3-2352b861281d-tls-certs\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.848300 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.848224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16b6a9a-b4ba-4d77-82b3-2352b861281d-tmp\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.848300 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.848255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2td96\" (UniqueName: \"kubernetes.io/projected/d16b6a9a-b4ba-4d77-82b3-2352b861281d-kube-api-access-2td96\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.850391 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.850371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16b6a9a-b4ba-4d77-82b3-2352b861281d-tmp\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.850514 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.850499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d16b6a9a-b4ba-4d77-82b3-2352b861281d-tls-certs\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.857471 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.857451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2td96\" (UniqueName: \"kubernetes.io/projected/d16b6a9a-b4ba-4d77-82b3-2352b861281d-kube-api-access-2td96\") pod \"kube-auth-proxy-6679dddbff-v668w\" (UID: \"d16b6a9a-b4ba-4d77-82b3-2352b861281d\") " pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:54.910236 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:54.910209    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w"
Sep 09 21:23:55.096426 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:55.096401    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c65cc4f5-2nxf2"]
Sep 09 21:23:55.097728 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:23:55.097704    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6636cbd4_3bb1_47ae_8462_88e87430ee89.slice/crio-2c75070d23680f31ab3a833e55db301b37f0514faccc120d27796152421077e2 WatchSource:0}: Error finding container 2c75070d23680f31ab3a833e55db301b37f0514faccc120d27796152421077e2: Status 404 returned error can't find the container with id 2c75070d23680f31ab3a833e55db301b37f0514faccc120d27796152421077e2
Sep 09 21:23:55.228671 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:55.228640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6679dddbff-v668w"]
Sep 09 21:23:55.232243 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:23:55.232217    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16b6a9a_b4ba_4d77_82b3_2352b861281d.slice/crio-fdaf0c954cfdaedd6f6f327858db3ce7a3907e123bdae21aa780d4e7e26c6907 WatchSource:0}: Error finding container fdaf0c954cfdaedd6f6f327858db3ce7a3907e123bdae21aa780d4e7e26c6907: Status 404 returned error can't find the container with id fdaf0c954cfdaedd6f6f327858db3ce7a3907e123bdae21aa780d4e7e26c6907
Sep 09 21:23:55.387442 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:55.387371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w" event={"ID":"d16b6a9a-b4ba-4d77-82b3-2352b861281d","Type":"ContainerStarted","Data":"fdaf0c954cfdaedd6f6f327858db3ce7a3907e123bdae21aa780d4e7e26c6907"}
Sep 09 21:23:55.388853 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:55.388827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c65cc4f5-2nxf2" event={"ID":"6636cbd4-3bb1-47ae-8462-88e87430ee89","Type":"ContainerStarted","Data":"ec9a40b11ca762168c9e3290e00e41f5c91d5fa23c035fda7ded36f0509a9b68"}
Sep 09 21:23:55.388993 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:55.388870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c65cc4f5-2nxf2" event={"ID":"6636cbd4-3bb1-47ae-8462-88e87430ee89","Type":"ContainerStarted","Data":"2c75070d23680f31ab3a833e55db301b37f0514faccc120d27796152421077e2"}
Sep 09 21:23:56.353170 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:56.353140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56b8fc5c8c-bwcw6"
Sep 09 21:23:56.375981 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:56.375661    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c65cc4f5-2nxf2" podStartSLOduration=2.375640999 podStartE2EDuration="2.375640999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:55.423396798 +0000 UTC m=+938.899089792" watchObservedRunningTime="2026-09-09 21:23:56.375640999 +0000 UTC m=+939.851333994"
Sep 09 21:23:58.407980 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:58.407951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w" event={"ID":"d16b6a9a-b4ba-4d77-82b3-2352b861281d","Type":"ContainerStarted","Data":"ab6da1dbf55a9449731965376d494e0c2765266ca07cc3ac89d87992f8855e65"}
Sep 09 21:23:58.430178 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:23:58.430001    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6679dddbff-v668w" podStartSLOduration=1.799895188 podStartE2EDuration="4.429987851s" totalImagesPullingTime="2.630092663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:23:58.429785083 +0000 UTC m=+941.905478077" watchObservedRunningTime="2026-09-09 21:23:58.429987851 +0000 UTC m=+941.905680844"
Sep 09 21:24:04.820214 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:04.820184    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:24:04.820564 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:04.820253    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:24:04.824769 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:04.824747    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:24:05.448253 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:05.448224    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c65cc4f5-2nxf2"
Sep 09 21:24:05.581890 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:05.581859    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdb4b46c8-5ngwh"]
Sep 09 21:24:30.601472 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.601418    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bdb4b46c8-5ngwh" podUID="5598cb0a-8e2c-4361-bbff-dacd7385e19e" containerName="console" containerID="cri-o://a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3" gracePeriod=15
Sep 09 21:24:30.835978 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.835957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:24:30.905628 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-oauth-config\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.905748 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905636    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-trusted-ca-bundle\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.905748 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905677    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-serving-cert\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.905748 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905713    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-service-ca\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.905939 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905756    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjdff\" (UniqueName: \"kubernetes.io/projected/5598cb0a-8e2c-4361-bbff-dacd7385e19e-kube-api-access-vjdff\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.905939 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-config\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.905939 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.905849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-oauth-serving-cert\") pod \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\" (UID: \"5598cb0a-8e2c-4361-bbff-dacd7385e19e\") "
Sep 09 21:24:30.906164 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.906034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:24:30.906273 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.906168    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-service-ca" (OuterVolumeSpecName: "service-ca") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:24:30.906273 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.906217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:24:30.906273 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.906213    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-config" (OuterVolumeSpecName: "console-config") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 21:24:30.907856 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.907835    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:24:30.908377 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.908358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 21:24:30.908449 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:30.908394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5598cb0a-8e2c-4361-bbff-dacd7385e19e-kube-api-access-vjdff" (OuterVolumeSpecName: "kube-api-access-vjdff") pod "5598cb0a-8e2c-4361-bbff-dacd7385e19e" (UID: "5598cb0a-8e2c-4361-bbff-dacd7385e19e"). InnerVolumeSpecName "kube-api-access-vjdff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:24:31.006881 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006860    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-trusted-ca-bundle\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.006881 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006881    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.007008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006891    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-service-ca\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.007008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006899    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjdff\" (UniqueName: \"kubernetes.io/projected/5598cb0a-8e2c-4361-bbff-dacd7385e19e-kube-api-access-vjdff\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.007008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006928    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.007008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006936    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5598cb0a-8e2c-4361-bbff-dacd7385e19e-oauth-serving-cert\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.007008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.006943    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5598cb0a-8e2c-4361-bbff-dacd7385e19e-console-oauth-config\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:24:31.550608 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.550578    2580 generic.go:356] "Generic (PLEG): container finished" podID="5598cb0a-8e2c-4361-bbff-dacd7385e19e" containerID="a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3" exitCode=0
Sep 09 21:24:31.550709 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.550621    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb4b46c8-5ngwh"
Sep 09 21:24:31.550709 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.550662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb4b46c8-5ngwh" event={"ID":"5598cb0a-8e2c-4361-bbff-dacd7385e19e","Type":"ContainerDied","Data":"a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3"}
Sep 09 21:24:31.550802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.550709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb4b46c8-5ngwh" event={"ID":"5598cb0a-8e2c-4361-bbff-dacd7385e19e","Type":"ContainerDied","Data":"c1981c76838e77f328420d2927cc65e7fd8bc0aaba3621063743047b65a3141e"}
Sep 09 21:24:31.550802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.550730    2580 scope.go:117] "RemoveContainer" containerID="a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3"
Sep 09 21:24:31.559328 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.559313    2580 scope.go:117] "RemoveContainer" containerID="a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3"
Sep 09 21:24:31.559617 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:24:31.559600    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3\": container with ID starting with a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3 not found: ID does not exist" containerID="a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3"
Sep 09 21:24:31.559669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.559626    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3"} err="failed to get container status \"a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3\": rpc error: code = NotFound desc = could not find container \"a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3\": container with ID starting with a065d041fff3b4fe7b8b8e334bad723acc6a1ba85ce718bf27ff2f5f9a8a93e3 not found: ID does not exist"
Sep 09 21:24:31.572654 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.572633    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdb4b46c8-5ngwh"]
Sep 09 21:24:31.578367 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:31.578349    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bdb4b46c8-5ngwh"]
Sep 09 21:24:33.029812 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:24:33.029787    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5598cb0a-8e2c-4361-bbff-dacd7385e19e" path="/var/lib/kubelet/pods/5598cb0a-8e2c-4361-bbff-dacd7385e19e/volumes"
Sep 09 21:25:24.011905 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.011871    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"]
Sep 09 21:25:24.012284 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.012233    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5598cb0a-8e2c-4361-bbff-dacd7385e19e" containerName="console"
Sep 09 21:25:24.012284 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.012247    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5598cb0a-8e2c-4361-bbff-dacd7385e19e" containerName="console"
Sep 09 21:25:24.012355 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.012307    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5598cb0a-8e2c-4361-bbff-dacd7385e19e" containerName="console"
Sep 09 21:25:24.016273 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.016257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:25:24.021761 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.021738    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 21:25:24.022014 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.022002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rr7r7\""
Sep 09 21:25:24.023075 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.023056    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 21:25:24.023533 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.023520    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 21:25:24.036103 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.036080    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"]
Sep 09 21:25:24.178446 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.178423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb7xw\" (UniqueName: \"kubernetes.io/projected/7c8090f1-db84-47a5-b54c-a9b5d6f701db-kube-api-access-vb7xw\") pod \"dns-operator-controller-manager-7b84cd7c9c-vwjpx\" (UID: \"7c8090f1-db84-47a5-b54c-a9b5d6f701db\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:25:24.279753 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.279681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb7xw\" (UniqueName: \"kubernetes.io/projected/7c8090f1-db84-47a5-b54c-a9b5d6f701db-kube-api-access-vb7xw\") pod \"dns-operator-controller-manager-7b84cd7c9c-vwjpx\" (UID: \"7c8090f1-db84-47a5-b54c-a9b5d6f701db\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:25:24.303533 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.303509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb7xw\" (UniqueName: \"kubernetes.io/projected/7c8090f1-db84-47a5-b54c-a9b5d6f701db-kube-api-access-vb7xw\") pod \"dns-operator-controller-manager-7b84cd7c9c-vwjpx\" (UID: \"7c8090f1-db84-47a5-b54c-a9b5d6f701db\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:25:24.325507 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.325486    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:25:24.615275 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.615254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"]
Sep 09 21:25:24.617975 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:25:24.617942    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8090f1_db84_47a5_b54c_a9b5d6f701db.slice/crio-57afa3236b27bc5d0add158ee61a3ce6b227a144de9a5592257bdda1436e5602 WatchSource:0}: Error finding container 57afa3236b27bc5d0add158ee61a3ce6b227a144de9a5592257bdda1436e5602: Status 404 returned error can't find the container with id 57afa3236b27bc5d0add158ee61a3ce6b227a144de9a5592257bdda1436e5602
Sep 09 21:25:24.620214 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.620194    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:25:24.781152 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:24.781124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx" event={"ID":"7c8090f1-db84-47a5-b54c-a9b5d6f701db","Type":"ContainerStarted","Data":"57afa3236b27bc5d0add158ee61a3ce6b227a144de9a5592257bdda1436e5602"}
Sep 09 21:25:27.797860 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:27.797827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx" event={"ID":"7c8090f1-db84-47a5-b54c-a9b5d6f701db","Type":"ContainerStarted","Data":"5312c86c54b0231bb5c5c5577e25e0afdea00743b3eaea358395ddbc415f2a3b"}
Sep 09 21:25:27.798262 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:27.797939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:25:27.837177 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:27.837137    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx" podStartSLOduration=2.369109848 podStartE2EDuration="4.83712533s" totalImagesPullingTime="2.468015482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:25:27.834107017 +0000 UTC m=+1031.309800010" watchObservedRunningTime="2026-09-09 21:25:27.83712533 +0000 UTC m=+1031.312818323"
Sep 09 21:25:38.804038 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:25:38.804007    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vwjpx"
Sep 09 21:26:12.099733 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.099658    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:26:12.104773 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.104754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.108211 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.108193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mqs9q\""
Sep 09 21:26:12.108640 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.108617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 21:26:12.115230 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.115203    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:26:12.124760 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.124743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpmc7\" (UniqueName: \"kubernetes.io/projected/94ecf966-164f-45aa-a185-0c622e20f897-kube-api-access-rpmc7\") pod \"limitador-limitador-84994f7ffc-cfpm2\" (UID: \"94ecf966-164f-45aa-a185-0c622e20f897\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.124871 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.124851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94ecf966-164f-45aa-a185-0c622e20f897-config-file\") pod \"limitador-limitador-84994f7ffc-cfpm2\" (UID: \"94ecf966-164f-45aa-a185-0c622e20f897\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.178419 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.178388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:26:12.226016 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.225983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpmc7\" (UniqueName: \"kubernetes.io/projected/94ecf966-164f-45aa-a185-0c622e20f897-kube-api-access-rpmc7\") pod \"limitador-limitador-84994f7ffc-cfpm2\" (UID: \"94ecf966-164f-45aa-a185-0c622e20f897\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.226179 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.226094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94ecf966-164f-45aa-a185-0c622e20f897-config-file\") pod \"limitador-limitador-84994f7ffc-cfpm2\" (UID: \"94ecf966-164f-45aa-a185-0c622e20f897\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.226690 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.226667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94ecf966-164f-45aa-a185-0c622e20f897-config-file\") pod \"limitador-limitador-84994f7ffc-cfpm2\" (UID: \"94ecf966-164f-45aa-a185-0c622e20f897\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.240265 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.240237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpmc7\" (UniqueName: \"kubernetes.io/projected/94ecf966-164f-45aa-a185-0c622e20f897-kube-api-access-rpmc7\") pod \"limitador-limitador-84994f7ffc-cfpm2\" (UID: \"94ecf966-164f-45aa-a185-0c622e20f897\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.415291 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.415196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:12.634182 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.634144    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b5cqj"]
Sep 09 21:26:12.637781 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.637758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:12.646058 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.646039    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-69kcj\""
Sep 09 21:26:12.653691 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.653663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b5cqj"]
Sep 09 21:26:12.699348 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.699325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:26:12.701329 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:26:12.701288    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ecf966_164f_45aa_a185_0c622e20f897.slice/crio-e56baec1e5c7804c27595c43de46bef828e6665fca17619a8a8f5970af070e08 WatchSource:0}: Error finding container e56baec1e5c7804c27595c43de46bef828e6665fca17619a8a8f5970af070e08: Status 404 returned error can't find the container with id e56baec1e5c7804c27595c43de46bef828e6665fca17619a8a8f5970af070e08
Sep 09 21:26:12.731418 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.731374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvvq\" (UniqueName: \"kubernetes.io/projected/2c73e3e1-cfc2-455a-8855-a66d3a451543-kube-api-access-6bvvq\") pod \"authorino-7bcfd8f9cd-b5cqj\" (UID: \"2c73e3e1-cfc2-455a-8855-a66d3a451543\") " pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:12.832897 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.832863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvvq\" (UniqueName: \"kubernetes.io/projected/2c73e3e1-cfc2-455a-8855-a66d3a451543-kube-api-access-6bvvq\") pod \"authorino-7bcfd8f9cd-b5cqj\" (UID: \"2c73e3e1-cfc2-455a-8855-a66d3a451543\") " pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:12.845283 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.845254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvvq\" (UniqueName: \"kubernetes.io/projected/2c73e3e1-cfc2-455a-8855-a66d3a451543-kube-api-access-6bvvq\") pod \"authorino-7bcfd8f9cd-b5cqj\" (UID: \"2c73e3e1-cfc2-455a-8855-a66d3a451543\") " pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:12.947031 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.947003    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:12.987958 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:12.987925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2" event={"ID":"94ecf966-164f-45aa-a185-0c622e20f897","Type":"ContainerStarted","Data":"e56baec1e5c7804c27595c43de46bef828e6665fca17619a8a8f5970af070e08"}
Sep 09 21:26:13.236016 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:13.235940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b5cqj"]
Sep 09 21:26:13.242999 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:26:13.242976    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c73e3e1_cfc2_455a_8855_a66d3a451543.slice/crio-5a2e5254248a91a9d01be74f6999b63f550898a23d9eea2f938e801d71b603e3 WatchSource:0}: Error finding container 5a2e5254248a91a9d01be74f6999b63f550898a23d9eea2f938e801d71b603e3: Status 404 returned error can't find the container with id 5a2e5254248a91a9d01be74f6999b63f550898a23d9eea2f938e801d71b603e3
Sep 09 21:26:13.993818 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:13.993781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2" event={"ID":"94ecf966-164f-45aa-a185-0c622e20f897","Type":"ContainerStarted","Data":"cf099ab4824e7ea1e1f5a0440b3c59d2834264c4c16aa7e438c0597f97b93e4b"}
Sep 09 21:26:13.994051 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:13.993896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:26:13.994997 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:13.994976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj" event={"ID":"2c73e3e1-cfc2-455a-8855-a66d3a451543","Type":"ContainerStarted","Data":"5a2e5254248a91a9d01be74f6999b63f550898a23d9eea2f938e801d71b603e3"}
Sep 09 21:26:14.017493 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:14.017447    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2" podStartSLOduration=0.975405216 podStartE2EDuration="2.017435358s" totalImagesPullingTime="1.042030142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:14.015790337 +0000 UTC m=+1077.491483333" watchObservedRunningTime="2026-09-09 21:26:14.017435358 +0000 UTC m=+1077.493128382"
Sep 09 21:26:16.006018 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:16.005978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj" event={"ID":"2c73e3e1-cfc2-455a-8855-a66d3a451543","Type":"ContainerStarted","Data":"2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f"}
Sep 09 21:26:16.024585 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:16.024541    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj" podStartSLOduration=2.204621254 podStartE2EDuration="4.024525123s" totalImagesPullingTime="1.819903869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:26:16.02385795 +0000 UTC m=+1079.499550944" watchObservedRunningTime="2026-09-09 21:26:16.024525123 +0000 UTC m=+1079.500218117"
Sep 09 21:26:19.595504 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:19.595473    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b5cqj"]
Sep 09 21:26:19.595849 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:19.595641    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj" podUID="2c73e3e1-cfc2-455a-8855-a66d3a451543" containerName="authorino" containerID="cri-o://2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f" gracePeriod=30
Sep 09 21:26:19.845321 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:19.845297    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:19.890008 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:19.889800    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bvvq\" (UniqueName: \"kubernetes.io/projected/2c73e3e1-cfc2-455a-8855-a66d3a451543-kube-api-access-6bvvq\") pod \"2c73e3e1-cfc2-455a-8855-a66d3a451543\" (UID: \"2c73e3e1-cfc2-455a-8855-a66d3a451543\") "
Sep 09 21:26:19.892253 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:19.892223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c73e3e1-cfc2-455a-8855-a66d3a451543-kube-api-access-6bvvq" (OuterVolumeSpecName: "kube-api-access-6bvvq") pod "2c73e3e1-cfc2-455a-8855-a66d3a451543" (UID: "2c73e3e1-cfc2-455a-8855-a66d3a451543"). InnerVolumeSpecName "kube-api-access-6bvvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 21:26:19.991025 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:19.990991    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bvvq\" (UniqueName: \"kubernetes.io/projected/2c73e3e1-cfc2-455a-8855-a66d3a451543-kube-api-access-6bvvq\") on node \"ip-10-0-141-64.ec2.internal\" DevicePath \"\""
Sep 09 21:26:20.024661 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.024636    2580 generic.go:356] "Generic (PLEG): container finished" podID="2c73e3e1-cfc2-455a-8855-a66d3a451543" containerID="2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f" exitCode=0
Sep 09 21:26:20.024749 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.024670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj" event={"ID":"2c73e3e1-cfc2-455a-8855-a66d3a451543","Type":"ContainerDied","Data":"2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f"}
Sep 09 21:26:20.024749 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.024673    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj"
Sep 09 21:26:20.024749 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.024696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-b5cqj" event={"ID":"2c73e3e1-cfc2-455a-8855-a66d3a451543","Type":"ContainerDied","Data":"5a2e5254248a91a9d01be74f6999b63f550898a23d9eea2f938e801d71b603e3"}
Sep 09 21:26:20.024749 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.024712    2580 scope.go:117] "RemoveContainer" containerID="2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f"
Sep 09 21:26:20.033060 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.033040    2580 scope.go:117] "RemoveContainer" containerID="2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f"
Sep 09 21:26:20.033358 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:26:20.033340    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f\": container with ID starting with 2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f not found: ID does not exist" containerID="2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f"
Sep 09 21:26:20.033418 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.033365    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f"} err="failed to get container status \"2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f\": rpc error: code = NotFound desc = could not find container \"2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f\": container with ID starting with 2f181c744b3fa82f5996227fd91465c9d583e806bb8586095b1d805385ee229f not found: ID does not exist"
Sep 09 21:26:20.054099 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.054077    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b5cqj"]
Sep 09 21:26:20.059512 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:20.059493    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-b5cqj"]
Sep 09 21:26:21.031601 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:21.031569    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c73e3e1-cfc2-455a-8855-a66d3a451543" path="/var/lib/kubelet/pods/2c73e3e1-cfc2-455a-8855-a66d3a451543/volumes"
Sep 09 21:26:25.001021 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:26:25.000991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"
Sep 09 21:27:23.743715 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:23.743682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:27:39.737297 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.737226    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"]
Sep 09 21:27:39.737729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.737589    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c73e3e1-cfc2-455a-8855-a66d3a451543" containerName="authorino"
Sep 09 21:27:39.737729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.737605    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c73e3e1-cfc2-455a-8855-a66d3a451543" containerName="authorino"
Sep 09 21:27:39.737729 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.737686    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c73e3e1-cfc2-455a-8855-a66d3a451543" containerName="authorino"
Sep 09 21:27:39.740157 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.740140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.743705 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.743681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 21:27:39.743778 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.743732    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 21:27:39.744774 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.744748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 21:27:39.744875 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.744817    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lcjgs\""
Sep 09 21:27:39.757166 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.757145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"]
Sep 09 21:27:39.807896 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.807868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.808026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.807900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97407490-d41c-4d8b-a17c-54edb736bd6e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.808026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.807937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.808026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.808002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.808125 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.808040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvp8\" (UniqueName: \"kubernetes.io/projected/97407490-d41c-4d8b-a17c-54edb736bd6e-kube-api-access-8tvp8\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.808162 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.808126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.908830 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.908803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.908974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.908847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.908974 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.908863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97407490-d41c-4d8b-a17c-54edb736bd6e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.909103 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.909010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.909103 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.909052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.909103 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.909089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvp8\" (UniqueName: \"kubernetes.io/projected/97407490-d41c-4d8b-a17c-54edb736bd6e-kube-api-access-8tvp8\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.909255 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.909196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.909408 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.909384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.909480 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.909462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.911382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.911361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97407490-d41c-4d8b-a17c-54edb736bd6e-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.911616 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.911602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97407490-d41c-4d8b-a17c-54edb736bd6e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:39.918705 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:39.918679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvp8\" (UniqueName: \"kubernetes.io/projected/97407490-d41c-4d8b-a17c-54edb736bd6e-kube-api-access-8tvp8\") pod \"e2e-distinct-2-simulated-kserve-859856b874-wc4ss\" (UID: \"97407490-d41c-4d8b-a17c-54edb736bd6e\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:40.051022 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:40.050998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:40.281050 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:40.281018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:27:40.333492 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:40.333473    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"]
Sep 09 21:27:40.335660 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:27:40.335632    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97407490_d41c_4d8b_a17c_54edb736bd6e.slice/crio-e803a0d0818db178162750f547217f518167981fd6e1ebcde397e3cd3c38b70d WatchSource:0}: Error finding container e803a0d0818db178162750f547217f518167981fd6e1ebcde397e3cd3c38b70d: Status 404 returned error can't find the container with id e803a0d0818db178162750f547217f518167981fd6e1ebcde397e3cd3c38b70d
Sep 09 21:27:40.399161 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:40.399132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerStarted","Data":"e803a0d0818db178162750f547217f518167981fd6e1ebcde397e3cd3c38b70d"}
Sep 09 21:27:41.405475 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:41.405447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerStarted","Data":"9523106a42094237127e886136c51c0c09ae2cb6015996a7798bf8f0b249d474"}
Sep 09 21:27:41.429487 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:41.429443    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podStartSLOduration=1.430473058 podStartE2EDuration="2.429427144s" totalImagesPullingTime="998.954086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:27:41.428181614 +0000 UTC m=+1164.903874609" watchObservedRunningTime="2026-09-09 21:27:41.429427144 +0000 UTC m=+1164.905120173"
Sep 09 21:27:42.412864 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:42.412826    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="9523106a42094237127e886136c51c0c09ae2cb6015996a7798bf8f0b249d474" exitCode=0
Sep 09 21:27:42.413288 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:42.412950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"9523106a42094237127e886136c51c0c09ae2cb6015996a7798bf8f0b249d474"}
Sep 09 21:27:42.413288 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:42.413265    2580 scope.go:117] "RemoveContainer" containerID="9523106a42094237127e886136c51c0c09ae2cb6015996a7798bf8f0b249d474"
Sep 09 21:27:43.419409 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:43.419380    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca" exitCode=0
Sep 09 21:27:43.419802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:43.419437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca"}
Sep 09 21:27:43.419802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:43.419493    2580 scope.go:117] "RemoveContainer" containerID="9523106a42094237127e886136c51c0c09ae2cb6015996a7798bf8f0b249d474"
Sep 09 21:27:43.419802 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:43.419730    2580 scope.go:117] "RemoveContainer" containerID="d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca"
Sep 09 21:27:43.419998 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:27:43.419904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:27:44.282304 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:44.282258    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:27:44.425814 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:44.425791    2580 scope.go:117] "RemoveContainer" containerID="d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca"
Sep 09 21:27:44.426184 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:27:44.425977    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:27:50.051638 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:50.051601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:50.052032 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:50.051659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:50.052032 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:50.051676    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:50.052032 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:50.051690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:27:50.052147 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:27:50.052077    2580 scope.go:117] "RemoveContainer" containerID="d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca"
Sep 09 21:27:50.052259 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:27:50.052241    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:04.025129 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:04.025091    2580 scope.go:117] "RemoveContainer" containerID="d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca"
Sep 09 21:28:04.522625 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:04.522595    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048" exitCode=0
Sep 09 21:28:04.522745 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:04.522641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048"}
Sep 09 21:28:04.522745 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:04.522685    2580 scope.go:117] "RemoveContainer" containerID="d0d9525fd15c6386388e5a0bdf7d07e8d2a6dc901af8a20c56af565f8b253aca"
Sep 09 21:28:04.523026 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:04.523004    2580 scope.go:117] "RemoveContainer" containerID="1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048"
Sep 09 21:28:04.523230 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:04.523203    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:10.051520 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:10.051488    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:10.051878 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:10.051547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:10.051878 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:10.051565    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:10.051878 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:10.051580    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:10.052014 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:10.051888    2580 scope.go:117] "RemoveContainer" containerID="1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048"
Sep 09 21:28:10.052089 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:10.052070    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:16.972291 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:16.972263    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:28:16.972777 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:16.972722    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:28:21.025825 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:21.025796    2580 scope.go:117] "RemoveContainer" containerID="1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048"
Sep 09 21:28:21.026219 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:21.025987    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:23.310383 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:23.310350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:28:32.025944 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:32.025876    2580 scope.go:117] "RemoveContainer" containerID="1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048"
Sep 09 21:28:32.656431 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:32.656368    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4" exitCode=0
Sep 09 21:28:32.656431 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:32.656424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"}
Sep 09 21:28:32.656566 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:32.656473    2580 scope.go:117] "RemoveContainer" containerID="1ec3a076e1325854b0887c8c6046b0b50082ec4c07524f3103230442256e6048"
Sep 09 21:28:32.656792 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:32.656771    2580 scope.go:117] "RemoveContainer" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"
Sep 09 21:28:32.657024 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:32.657005    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:36.002978 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.002945    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"]
Sep 09 21:28:36.007504 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.007482    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.010584 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.010565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 09 21:28:36.018371 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.018348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"]
Sep 09 21:28:36.043379 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.043348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxrr\" (UniqueName: \"kubernetes.io/projected/b8ec99ac-4b85-4a83-8df4-38ac60901e60-kube-api-access-4dxrr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.043491 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.043409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ec99ac-4b85-4a83-8df4-38ac60901e60-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.043491 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.043439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.043491 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.043486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.043620 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.043540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.043620 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.043578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144404 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ec99ac-4b85-4a83-8df4-38ac60901e60-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144520 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144520 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144520 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144662 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144662 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxrr\" (UniqueName: \"kubernetes.io/projected/b8ec99ac-4b85-4a83-8df4-38ac60901e60-kube-api-access-4dxrr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144812 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.144949 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.144902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.146804 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.146787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ec99ac-4b85-4a83-8df4-38ac60901e60-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.147062 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.147047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ec99ac-4b85-4a83-8df4-38ac60901e60-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.158133 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.158111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxrr\" (UniqueName: \"kubernetes.io/projected/b8ec99ac-4b85-4a83-8df4-38ac60901e60-kube-api-access-4dxrr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lzwrb\" (UID: \"b8ec99ac-4b85-4a83-8df4-38ac60901e60\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.319331 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.319303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:36.596210 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.596183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"]
Sep 09 21:28:36.597281 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:28:36.597257    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ec99ac_4b85_4a83_8df4_38ac60901e60.slice/crio-51ec9f3b201e86d4fb4d2d251fc0ebb3b828c070eb6ef1e9723b8aff4c4a7194 WatchSource:0}: Error finding container 51ec9f3b201e86d4fb4d2d251fc0ebb3b828c070eb6ef1e9723b8aff4c4a7194: Status 404 returned error can't find the container with id 51ec9f3b201e86d4fb4d2d251fc0ebb3b828c070eb6ef1e9723b8aff4c4a7194
Sep 09 21:28:36.677347 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:36.677306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb" event={"ID":"b8ec99ac-4b85-4a83-8df4-38ac60901e60","Type":"ContainerStarted","Data":"51ec9f3b201e86d4fb4d2d251fc0ebb3b828c070eb6ef1e9723b8aff4c4a7194"}
Sep 09 21:28:37.282931 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:37.282879    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:28:37.683473 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:37.683392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb" event={"ID":"b8ec99ac-4b85-4a83-8df4-38ac60901e60","Type":"ContainerStarted","Data":"147c91383a50a86159bc7338439395aa9010a19338f36f390e58f3d74c6209c2"}
Sep 09 21:28:37.710823 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:37.710776    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb" podStartSLOduration=2.524894281 podStartE2EDuration="2.710761001s" totalImagesPullingTime="185.86672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:28:37.708744883 +0000 UTC m=+1221.184437884" watchObservedRunningTime="2026-09-09 21:28:37.710761001 +0000 UTC m=+1221.186453995"
Sep 09 21:28:40.051087 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:40.051056    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:40.051445 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:40.051109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:40.051445 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:40.051126    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:40.051445 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:40.051139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:28:40.051445 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:40.051421    2580 scope.go:117] "RemoveContainer" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"
Sep 09 21:28:40.051579 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:40.051561    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:44.575870 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:44.575834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:28:46.319672 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:46.319644    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:46.320082 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:46.319715    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:46.332672 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:46.332647    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:46.737192 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:46.737112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lzwrb"
Sep 09 21:28:52.025543 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.025511    2580 scope.go:117] "RemoveContainer" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"
Sep 09 21:28:52.025988 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:52.025684    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:28:52.553037 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.553005    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"]
Sep 09 21:28:52.556457 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.556440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.560772 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.560752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 21:28:52.577005 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.576983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"]
Sep 09 21:28:52.677027 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.677002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.677105 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.677046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.677105 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.677069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.677105 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.677084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnkq7\" (UniqueName: \"kubernetes.io/projected/e546027f-f0c3-4c36-817b-85d671507427-kube-api-access-fnkq7\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.677220 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.677184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e546027f-f0c3-4c36-817b-85d671507427-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.677220 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.677213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778101 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778182 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778252 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778290 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnkq7\" (UniqueName: \"kubernetes.io/projected/e546027f-f0c3-4c36-817b-85d671507427-kube-api-access-fnkq7\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778332 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e546027f-f0c3-4c36-817b-85d671507427-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778332 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778475 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778613 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.778679 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.778644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.780798 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.780775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e546027f-f0c3-4c36-817b-85d671507427-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.781014 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.780996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e546027f-f0c3-4c36-817b-85d671507427-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.789177 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.789156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnkq7\" (UniqueName: \"kubernetes.io/projected/e546027f-f0c3-4c36-817b-85d671507427-kube-api-access-fnkq7\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2\" (UID: \"e546027f-f0c3-4c36-817b-85d671507427\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:52.866651 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:52.866596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:28:53.156175 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:53.156105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"]
Sep 09 21:28:53.160331 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:28:53.160306    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode546027f_f0c3_4c36_817b_85d671507427.slice/crio-1a5ae4309c654600939002cc49a1cb8325dda8f786586271f07561d5cd67eb05 WatchSource:0}: Error finding container 1a5ae4309c654600939002cc49a1cb8325dda8f786586271f07561d5cd67eb05: Status 404 returned error can't find the container with id 1a5ae4309c654600939002cc49a1cb8325dda8f786586271f07561d5cd67eb05
Sep 09 21:28:53.760792 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:53.760702    2580 generic.go:356] "Generic (PLEG): container finished" podID="e546027f-f0c3-4c36-817b-85d671507427" containerID="17bbe18906b076a04099e54cf3ac20201a0160243ab705062d45993e0b8a6a91" exitCode=0
Sep 09 21:28:53.760940 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:53.760790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerDied","Data":"17bbe18906b076a04099e54cf3ac20201a0160243ab705062d45993e0b8a6a91"}
Sep 09 21:28:53.760940 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:53.760836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerStarted","Data":"1a5ae4309c654600939002cc49a1cb8325dda8f786586271f07561d5cd67eb05"}
Sep 09 21:28:53.761029 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:53.760952    2580 scope.go:117] "RemoveContainer" containerID="17bbe18906b076a04099e54cf3ac20201a0160243ab705062d45993e0b8a6a91"
Sep 09 21:28:54.379469 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:54.379402    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:28:54.767641 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:54.767611    2580 generic.go:356] "Generic (PLEG): container finished" podID="e546027f-f0c3-4c36-817b-85d671507427" containerID="79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230" exitCode=0
Sep 09 21:28:54.767795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:54.767665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerDied","Data":"79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230"}
Sep 09 21:28:54.767795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:54.767722    2580 scope.go:117] "RemoveContainer" containerID="17bbe18906b076a04099e54cf3ac20201a0160243ab705062d45993e0b8a6a91"
Sep 09 21:28:54.767996 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:54.767982    2580 scope.go:117] "RemoveContainer" containerID="79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230"
Sep 09 21:28:54.768225 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:54.768204    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:28:55.774103 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:28:55.774070    2580 scope.go:117] "RemoveContainer" containerID="79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230"
Sep 09 21:28:55.774524 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:28:55.774282    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:29:02.867349 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:02.867318    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:02.867795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:02.867374    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:02.867795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:02.867391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:02.867795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:02.867404    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:02.867795 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:02.867734    2580 scope.go:117] "RemoveContainer" containerID="79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230"
Sep 09 21:29:02.867944 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:02.867889    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:29:05.025519 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:05.025492    2580 scope.go:117] "RemoveContainer" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"
Sep 09 21:29:05.025869 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:05.025642    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:29:09.011137 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.011062    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"]
Sep 09 21:29:09.015739 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.015715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.018902 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.018882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 09 21:29:09.031672 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.031645    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"]
Sep 09 21:29:09.106465 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.106422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ce4bfe-03cf-4128-be59-0fa52e970e06-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.106465 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.106462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.106703 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.106669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.106840 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.106823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.106886 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.106851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.106969 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.106892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5ff\" (UniqueName: \"kubernetes.io/projected/32ce4bfe-03cf-4128-be59-0fa52e970e06-kube-api-access-4t5ff\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.207750 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.207710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ce4bfe-03cf-4128-be59-0fa52e970e06-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.207750 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.207754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208000 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.207788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208000 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.207846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208000 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.207862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208000 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.207881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5ff\" (UniqueName: \"kubernetes.io/projected/32ce4bfe-03cf-4128-be59-0fa52e970e06-kube-api-access-4t5ff\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208188 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.208163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208505 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.208215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.208505 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.208300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.210237 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.210211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ce4bfe-03cf-4128-be59-0fa52e970e06-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.210483 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.210464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ce4bfe-03cf-4128-be59-0fa52e970e06-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.217642 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.217621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5ff\" (UniqueName: \"kubernetes.io/projected/32ce4bfe-03cf-4128-be59-0fa52e970e06-kube-api-access-4t5ff\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gthhs\" (UID: \"32ce4bfe-03cf-4128-be59-0fa52e970e06\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.324687 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.324659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:09.600668 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.600640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"]
Sep 09 21:29:09.601947 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:29:09.601896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32ce4bfe_03cf_4128_be59_0fa52e970e06.slice/crio-e414ee5e07d0361b23bfcf35bdd112ea60cff35dd119cf219d6d3c3ef4658483 WatchSource:0}: Error finding container e414ee5e07d0361b23bfcf35bdd112ea60cff35dd119cf219d6d3c3ef4658483: Status 404 returned error can't find the container with id e414ee5e07d0361b23bfcf35bdd112ea60cff35dd119cf219d6d3c3ef4658483
Sep 09 21:29:09.842303 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:09.842268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerStarted","Data":"e414ee5e07d0361b23bfcf35bdd112ea60cff35dd119cf219d6d3c3ef4658483"}
Sep 09 21:29:10.849630 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:10.849591    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ce4bfe-03cf-4128-be59-0fa52e970e06" containerID="c31caeba5c9b6408e4f874afc2c063f167c8ceb0fc6da75a96a4f4937bf89062" exitCode=0
Sep 09 21:29:10.850013 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:10.849674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerDied","Data":"c31caeba5c9b6408e4f874afc2c063f167c8ceb0fc6da75a96a4f4937bf89062"}
Sep 09 21:29:10.850013 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:10.849937    2580 scope.go:117] "RemoveContainer" containerID="c31caeba5c9b6408e4f874afc2c063f167c8ceb0fc6da75a96a4f4937bf89062"
Sep 09 21:29:11.289430 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:11.289397    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-cfpm2"]
Sep 09 21:29:11.857533 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:11.857503    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ce4bfe-03cf-4128-be59-0fa52e970e06" containerID="49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57" exitCode=0
Sep 09 21:29:11.857932 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:11.857593    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerDied","Data":"49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57"}
Sep 09 21:29:11.857932 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:11.857645    2580 scope.go:117] "RemoveContainer" containerID="c31caeba5c9b6408e4f874afc2c063f167c8ceb0fc6da75a96a4f4937bf89062"
Sep 09 21:29:11.857932 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:11.857889    2580 scope.go:117] "RemoveContainer" containerID="49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57"
Sep 09 21:29:11.858113 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:11.858095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:12.864594 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:12.864567    2580 scope.go:117] "RemoveContainer" containerID="49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57"
Sep 09 21:29:12.865028 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:12.864768    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:17.027607 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.027579    2580 scope.go:117] "RemoveContainer" containerID="79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230"
Sep 09 21:29:17.027999 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.027808    2580 scope.go:117] "RemoveContainer" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"
Sep 09 21:29:17.887398 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.887367    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24" exitCode=0
Sep 09 21:29:17.887528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.887434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"}
Sep 09 21:29:17.887528 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.887484    2580 scope.go:117] "RemoveContainer" containerID="523e4289d3356346589dd91e426fb07e01cac28cec7a1caf670b20beaf1faad4"
Sep 09 21:29:17.887840 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.887817    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:29:17.888047 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:17.888029    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:29:17.889507 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.889487    2580 generic.go:356] "Generic (PLEG): container finished" podID="e546027f-f0c3-4c36-817b-85d671507427" containerID="c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7" exitCode=0
Sep 09 21:29:17.889608 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.889567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerDied","Data":"c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7"}
Sep 09 21:29:17.889869 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.889855    2580 scope.go:117] "RemoveContainer" containerID="c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7"
Sep 09 21:29:17.890062 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:17.890044    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:29:17.897982 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:17.897965    2580 scope.go:117] "RemoveContainer" containerID="79ea229359e821aef2d628773594db763d572cd5bc2eca0822bb2960d9583230"
Sep 09 21:29:19.325589 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:19.325560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:19.325952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:19.325600    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:19.325952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:19.325611    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:19.325952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:19.325621    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:19.325952 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:19.325884    2580 scope.go:117] "RemoveContainer" containerID="49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57"
Sep 09 21:29:19.326099 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:19.326033    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:20.051377 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:20.051354    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:29:20.051512 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:20.051398    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:29:20.051512 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:20.051419    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:29:20.051512 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:20.051432    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:29:20.051719 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:20.051707    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:29:20.051858 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:20.051843    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:29:22.867562 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:22.867526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:22.868005 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:22.867580    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:22.868005 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:22.867596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:22.868005 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:22.867610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:22.868005 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:22.867865    2580 scope.go:117] "RemoveContainer" containerID="c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7"
Sep 09 21:29:22.868167 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:22.868046    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:29:34.026086 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:34.026054    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:29:34.026532 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:34.026242    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:29:35.025316 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:35.025282    2580 scope.go:117] "RemoveContainer" containerID="49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57"
Sep 09 21:29:35.972269 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:35.972188    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ce4bfe-03cf-4128-be59-0fa52e970e06" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc" exitCode=0
Sep 09 21:29:35.972697 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:35.972264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerDied","Data":"1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"}
Sep 09 21:29:35.972697 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:35.972310    2580 scope.go:117] "RemoveContainer" containerID="49a201830ceb64f33f3cf4ae61dd74b717f2bd588821e246f1442e1394e47f57"
Sep 09 21:29:35.972697 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:35.972639    2580 scope.go:117] "RemoveContainer" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"
Sep 09 21:29:35.972851 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:35.972831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:37.031060 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:37.031035    2580 scope.go:117] "RemoveContainer" containerID="c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7"
Sep 09 21:29:37.031435 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:37.031201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:29:39.325373 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:39.325339    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:39.325755 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:39.325385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:39.325755 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:39.325397    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:39.325755 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:39.325481    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:29:39.325883 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:39.325763    2580 scope.go:117] "RemoveContainer" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"
Sep 09 21:29:39.325974 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:39.325955    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:39.992191 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:39.992154    2580 scope.go:117] "RemoveContainer" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"
Sep 09 21:29:39.992395 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:39.992370    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:49.026033 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:49.026002    2580 scope.go:117] "RemoveContainer" containerID="c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7"
Sep 09 21:29:49.026465 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:49.026193    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:29:49.026465 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:49.026373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:29:50.037711 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:50.037680    2580 generic.go:356] "Generic (PLEG): container finished" podID="e546027f-f0c3-4c36-817b-85d671507427" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0" exitCode=0
Sep 09 21:29:50.038104 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:50.037753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerDied","Data":"d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"}
Sep 09 21:29:50.038104 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:50.037809    2580 scope.go:117] "RemoveContainer" containerID="c71131d776fa196e7d0d42783db687c6d6e1c36af170e2d267309b47a1125ea7"
Sep 09 21:29:50.038104 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:50.038098    2580 scope.go:117] "RemoveContainer" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"
Sep 09 21:29:50.038313 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:50.038289    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:29:51.024953 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:51.024928    2580 scope.go:117] "RemoveContainer" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"
Sep 09 21:29:51.025123 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:51.025070    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:29:52.867355 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:52.867326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:52.867740 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:52.867376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:52.867740 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:52.867392    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:52.867740 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:52.867407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:29:52.867740 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:29:52.867660    2580 scope.go:117] "RemoveContainer" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"
Sep 09 21:29:52.867947 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:29:52.867800    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:30:03.025754 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:03.025721    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:30:03.026173 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:03.025952    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:30:04.025588 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:04.025563    2580 scope.go:117] "RemoveContainer" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"
Sep 09 21:30:05.104841 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:05.104747    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ce4bfe-03cf-4128-be59-0fa52e970e06" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72" exitCode=0
Sep 09 21:30:05.104841 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:05.104793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerDied","Data":"025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"}
Sep 09 21:30:05.104841 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:05.104826    2580 scope.go:117] "RemoveContainer" containerID="1365736a7a95a1718a9143ea0cbf78807e21a046301aeced9e15e18e769f0cbc"
Sep 09 21:30:05.105442 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:05.105238    2580 scope.go:117] "RemoveContainer" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"
Sep 09 21:30:05.105494 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:05.105439    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:08.025341 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:08.025312    2580 scope.go:117] "RemoveContainer" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"
Sep 09 21:30:08.025719 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:08.025467    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:30:09.325108 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:09.325072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:09.325495 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:09.325120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:09.325495 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:09.325133    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:09.325495 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:09.325142    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:09.325608 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:09.325528    2580 scope.go:117] "RemoveContainer" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"
Sep 09 21:30:09.325707 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:09.325688    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:16.025479 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:16.025453    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:30:16.025879 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:16.025612    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:30:20.025899 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:20.025872    2580 scope.go:117] "RemoveContainer" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"
Sep 09 21:30:20.026338 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:20.026094    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:21.025731 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:21.025702    2580 scope.go:117] "RemoveContainer" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"
Sep 09 21:30:21.025941 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:21.025895    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:30:27.027805 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:27.027782    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:30:27.028271 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:27.027943    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:30:31.026069 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:31.026038    2580 scope.go:117] "RemoveContainer" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"
Sep 09 21:30:31.026417 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:31.026224    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:36.025806 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:36.025780    2580 scope.go:117] "RemoveContainer" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"
Sep 09 21:30:36.026159 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:36.026043    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 21:30:37.257382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:37.257355    2580 generic.go:356] "Generic (PLEG): container finished" podID="e546027f-f0c3-4c36-817b-85d671507427" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c" exitCode=0
Sep 09 21:30:37.257815 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:37.257404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerDied","Data":"79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"}
Sep 09 21:30:37.257815 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:37.257463    2580 scope.go:117] "RemoveContainer" containerID="d3ecb29b8a5cb4f9973d2dc66012f4de8408f5fd7714cc653101875c3f3a01b0"
Sep 09 21:30:37.257815 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:37.257755    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:30:37.258019 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:37.257972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:30:39.025769 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:39.025696    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:30:39.268871 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:39.268847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerStarted","Data":"1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"}
Sep 09 21:30:40.052068 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.052037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:30:40.052397 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.052104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:30:40.053112 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.053088    2580 prober.go:120] "Probe failed" probeType="Startup" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.36:8000/health\": dial tcp 10.134.0.36:8000: connect: connection refused"
Sep 09 21:30:40.275030 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.275003    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c" exitCode=0
Sep 09 21:30:40.275133 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.275092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"}
Sep 09 21:30:40.275198 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.275148    2580 scope.go:117] "RemoveContainer" containerID="a63e4d68446f75d6d14c6acdc703bc3dbad6f75a6de70dd082ae7d2de7379f24"
Sep 09 21:30:40.275355 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:40.275342    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:30:40.275563 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:40.275542    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:30:41.280982 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:41.280957    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:30:41.281363 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:41.281141    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:30:42.867074 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:42.867040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:30:42.867408 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:42.867132    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:30:42.867408 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:42.867155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:30:42.867408 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:42.867168    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:30:42.867532 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:42.867458    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:30:42.867652 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:42.867632    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:30:46.025394 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:46.025362    2580 scope.go:117] "RemoveContainer" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"
Sep 09 21:30:46.303316 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:46.303291    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ce4bfe-03cf-4128-be59-0fa52e970e06" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1" exitCode=0
Sep 09 21:30:46.303421 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:46.303340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerDied","Data":"d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"}
Sep 09 21:30:46.303421 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:46.303403    2580 scope.go:117] "RemoveContainer" containerID="025312e518d56b0053edde02adac14ae980e659355bb38d7b88d8c39495c6c72"
Sep 09 21:30:46.303745 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:46.303730    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:30:46.303949 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:46.303900    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:49.325089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:49.325057    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:49.325429 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:49.325098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:49.325429 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:49.325109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:49.325429 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:49.325116    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:30:49.325429 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:49.325386    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:30:49.325565 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:49.325536    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:50.051353 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:50.051319    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:30:50.051489 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:50.051369    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss"
Sep 09 21:30:50.051668 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:50.051656    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:30:50.051803 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:50.051787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:30:50.325255 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:50.325199    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:30:50.325556 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:50.325336    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:30:57.027877 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:30:57.027853    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:30:57.028256 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:30:57.028002    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:31:04.025633 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:04.025606    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:31:04.026079 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:04.025744    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:31:05.025862 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:05.025835    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:31:05.026310 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:05.026010    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:31:08.026007 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:08.025981    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:31:08.026356 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:08.026141    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:31:16.025636 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:16.025605    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:31:16.025993 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:16.025743    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:31:20.025768 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:20.025742    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:31:20.026119 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:20.025892    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:31:23.025488 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:23.025464    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:31:23.025832 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:23.025621    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:31:31.026068 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:31.026035    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:31:31.026426 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:31.026139    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:31:31.026426 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:31.026233    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:31:31.026426 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:31.026261    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:31:35.031018 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:35.030987    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:31:35.031418 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:35.031178    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:31:42.025341 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:42.025314    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:31:42.025690 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:42.025450    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:31:43.025763 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:43.025734    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:31:43.026125 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:43.025881    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:31:49.025426 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:49.025397    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:31:49.025856 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:49.025546    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:31:54.026044 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:54.026020    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:31:54.026362 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:54.026149    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:31:55.025666 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:31:55.025637    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:31:55.025841 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:31:55.025785    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:32:03.025516 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:03.025484    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:32:03.644275 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:03.644215    2580 generic.go:356] "Generic (PLEG): container finished" podID="e546027f-f0c3-4c36-817b-85d671507427" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8" exitCode=0
Sep 09 21:32:03.644382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:03.644287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" event={"ID":"e546027f-f0c3-4c36-817b-85d671507427","Type":"ContainerDied","Data":"b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"}
Sep 09 21:32:03.644382 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:03.644348    2580 scope.go:117] "RemoveContainer" containerID="79e2b7c6986e607bdecb99c6396470c7bd4679dd09be4f9cf9a73dd64502a11c"
Sep 09 21:32:03.644605 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:03.644588    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:32:03.644807 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:03.644785    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:32:05.025665 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:05.025634    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:32:05.026039 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:05.025830    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:32:09.025890 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:09.025812    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:32:09.674323 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:09.674263    2580 generic.go:356] "Generic (PLEG): container finished" podID="32ce4bfe-03cf-4128-be59-0fa52e970e06" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e" exitCode=0
Sep 09 21:32:09.674410 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:09.674327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" event={"ID":"32ce4bfe-03cf-4128-be59-0fa52e970e06","Type":"ContainerDied","Data":"b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"}
Sep 09 21:32:09.674410 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:09.674364    2580 scope.go:117] "RemoveContainer" containerID="d69f8b092b3781a1511ca481c8068f431c1674b3a6f6878c95e676c1ff2ed8d1"
Sep 09 21:32:09.674641 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:09.674624    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:32:09.674808 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:09.674791    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:32:12.867568 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:12.867539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:32:12.867960 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:12.867596    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:32:12.867960 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:12.867610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:32:12.867960 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:12.867622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2"
Sep 09 21:32:12.868076 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:12.867983    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:32:12.868158 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:12.868141    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:32:19.025167 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:19.025141    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:32:19.025541 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:19.025289    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:32:19.325893 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:19.325812    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:32:19.325893 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:19.325857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:32:19.325893 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:19.325868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:32:19.325893 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:19.325878    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs"
Sep 09 21:32:19.326176 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:19.326164    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:32:19.326327 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:19.326308    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:32:28.025545 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:28.025512    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:32:28.025932 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:28.025684    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:32:30.025632 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:30.025598    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:32:30.026089 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:30.025745    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:32:30.026089 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:30.025752    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:32:30.026089 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:30.025971    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:32:41.456342 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:41.456313    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_e546027f-f0c3-4c36-817b-85d671507427/main/5.log"
Sep 09 21:32:41.572208 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:41.572180    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_e546027f-f0c3-4c36-817b-85d671507427/main/5.log"
Sep 09 21:32:42.025436 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:42.025410    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:32:42.025592 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:42.025565    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:32:44.025563 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:44.025530    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:32:44.026038 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:44.025747    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:32:45.025345 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:45.025318    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:32:45.025497 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:45.025455    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:32:48.854504 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:48.854480    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-l8r85_c1d090e4-9652-4cda-9fab-de7ec028b0b6/copy-manifests/0.log"
Sep 09 21:32:48.861966 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:48.861939    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-l8r85_c1d090e4-9652-4cda-9fab-de7ec028b0b6/manager/0.log"
Sep 09 21:32:50.591576 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:50.591543    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-vwjpx_7c8090f1-db84-47a5-b54c-a9b5d6f701db/manager/0.log"
Sep 09 21:32:50.940668 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:50.940594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-cfpm2_94ecf966-164f-45aa-a185-0c622e20f897/limitador/0.log"
Sep 09 21:32:51.714104 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:51.714080    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-v668w_d16b6a9a-b4ba-4d77-82b3-2352b861281d/kube-auth-proxy/0.log"
Sep 09 21:32:52.158085 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:52.158050    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5589f67c66-9ztht_3c915d66-6764-4ea7-8ffe-c4a5f10ae579/router/0.log"
Sep 09 21:32:52.482220 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:52.482141    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-wc4ss_97407490-d41c-4d8b-a17c-54edb736bd6e/main/5.log"
Sep 09 21:32:52.795100 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:52.795070    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lzwrb_b8ec99ac-4b85-4a83-8df4-38ac60901e60/main/0.log"
Sep 09 21:32:53.002853 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:53.002822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_e546027f-f0c3-4c36-817b-85d671507427/main/5.log"
Sep 09 21:32:53.114045 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:53.113966    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_32ce4bfe-03cf-4128-be59-0fa52e970e06/main/5.log"
Sep 09 21:32:57.027500 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:57.027468    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:32:57.027861 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:57.027656    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:32:58.026339 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.026299    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:32:58.026544 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:58.026515    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:32:58.514506 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.514473    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gc6bv/must-gather-lh2sf"]
Sep 09 21:32:58.517840 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.517824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.523257 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.523224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gc6bv\"/\"kube-root-ca.crt\""
Sep 09 21:32:58.527049 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.527034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gc6bv\"/\"default-dockercfg-xsb7r\""
Sep 09 21:32:58.531492 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.531475    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gc6bv\"/\"openshift-service-ca.crt\""
Sep 09 21:32:58.557222 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.557190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc6bv/must-gather-lh2sf"]
Sep 09 21:32:58.653682 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.653642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxr5r\" (UniqueName: \"kubernetes.io/projected/8af2949a-44a1-4140-b82d-8f8d34041870-kube-api-access-jxr5r\") pod \"must-gather-lh2sf\" (UID: \"8af2949a-44a1-4140-b82d-8f8d34041870\") " pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.653851 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.653700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8af2949a-44a1-4140-b82d-8f8d34041870-must-gather-output\") pod \"must-gather-lh2sf\" (UID: \"8af2949a-44a1-4140-b82d-8f8d34041870\") " pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.754308 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.754266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8af2949a-44a1-4140-b82d-8f8d34041870-must-gather-output\") pod \"must-gather-lh2sf\" (UID: \"8af2949a-44a1-4140-b82d-8f8d34041870\") " pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.754506 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.754381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxr5r\" (UniqueName: \"kubernetes.io/projected/8af2949a-44a1-4140-b82d-8f8d34041870-kube-api-access-jxr5r\") pod \"must-gather-lh2sf\" (UID: \"8af2949a-44a1-4140-b82d-8f8d34041870\") " pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.754637 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.754614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8af2949a-44a1-4140-b82d-8f8d34041870-must-gather-output\") pod \"must-gather-lh2sf\" (UID: \"8af2949a-44a1-4140-b82d-8f8d34041870\") " pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.767570 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.767509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxr5r\" (UniqueName: \"kubernetes.io/projected/8af2949a-44a1-4140-b82d-8f8d34041870-kube-api-access-jxr5r\") pod \"must-gather-lh2sf\" (UID: \"8af2949a-44a1-4140-b82d-8f8d34041870\") " pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:58.827055 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:58.827020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc6bv/must-gather-lh2sf"
Sep 09 21:32:59.025595 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:59.025496    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:32:59.025772 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:32:59.025680    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:32:59.108134 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:59.108110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc6bv/must-gather-lh2sf"]
Sep 09 21:32:59.110335 ip-10-0-141-64 kubenswrapper[2580]: W0909 21:32:59.110309    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8af2949a_44a1_4140_b82d_8f8d34041870.slice/crio-90b7fd4ed80a7ab8f186b86dbc5f8874916fccbb5470dd1dae4b23f2d949cdf5 WatchSource:0}: Error finding container 90b7fd4ed80a7ab8f186b86dbc5f8874916fccbb5470dd1dae4b23f2d949cdf5: Status 404 returned error can't find the container with id 90b7fd4ed80a7ab8f186b86dbc5f8874916fccbb5470dd1dae4b23f2d949cdf5
Sep 09 21:32:59.915820 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:32:59.915785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/must-gather-lh2sf" event={"ID":"8af2949a-44a1-4140-b82d-8f8d34041870","Type":"ContainerStarted","Data":"90b7fd4ed80a7ab8f186b86dbc5f8874916fccbb5470dd1dae4b23f2d949cdf5"}
Sep 09 21:33:00.926310 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:00.926270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/must-gather-lh2sf" event={"ID":"8af2949a-44a1-4140-b82d-8f8d34041870","Type":"ContainerStarted","Data":"31fc52fc1bf9ef3235b1a5bc1a4ab180fcfb23f1633e3a90ff97f2d1f8d70b1a"}
Sep 09 21:33:00.926660 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:00.926322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/must-gather-lh2sf" event={"ID":"8af2949a-44a1-4140-b82d-8f8d34041870","Type":"ContainerStarted","Data":"50b9a6bc20010a236020a2ec2c821c3715b57cd4b7bb574111fca9d3e53632c2"}
Sep 09 21:33:00.947766 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:00.947699    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gc6bv/must-gather-lh2sf" podStartSLOduration=2.072258833 podStartE2EDuration="2.947674449s" totalImagesPullingTime="875.415616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:33:00.945836558 +0000 UTC m=+1484.421529554" watchObservedRunningTime="2026-09-09 21:33:00.947674449 +0000 UTC m=+1484.423367445"
Sep 09 21:33:01.780363 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:01.780320    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kwhf8_d1068620-d122-49bf-80fa-01755da20901/global-pull-secret-syncer/0.log"
Sep 09 21:33:01.893785 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:01.893754    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g29wp_cc0f37c8-6b62-4fcd-b3ce-1037223375ce/konnectivity-agent/0.log"
Sep 09 21:33:01.978617 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:01.978591    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-64.ec2.internal_4392e07847543f3d7d91590de7915159/haproxy/0.log"
Sep 09 21:33:06.031262 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:06.031219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-vwjpx_7c8090f1-db84-47a5-b54c-a9b5d6f701db/manager/0.log"
Sep 09 21:33:06.215672 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:06.215638    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-cfpm2_94ecf966-164f-45aa-a185-0c622e20f897/limitador/0.log"
Sep 09 21:33:08.023728 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.023691    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-jsrhv_9fc6dede-5a02-46ae-9061-ef114771785e/cluster-monitoring-operator/0.log"
Sep 09 21:33:08.153032 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.152994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bc99475cc-mvg89_5a78cee9-a6c4-4a2c-8963-b4d73c90129a/metrics-server/0.log"
Sep 09 21:33:08.458029 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.457906    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pv9m2_f2de1b83-d527-4855-b76a-e762f8e1744b/node-exporter/0.log"
Sep 09 21:33:08.485372 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.485349    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pv9m2_f2de1b83-d527-4855-b76a-e762f8e1744b/kube-rbac-proxy/0.log"
Sep 09 21:33:08.518780 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.518749    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pv9m2_f2de1b83-d527-4855-b76a-e762f8e1744b/init-textfile/0.log"
Sep 09 21:33:08.581430 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.581403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-b5lwk_65bfa231-6570-48eb-99ff-723ad77a2cf5/kube-rbac-proxy-main/0.log"
Sep 09 21:33:08.656067 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.655982    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-b5lwk_65bfa231-6570-48eb-99ff-723ad77a2cf5/kube-rbac-proxy-self/0.log"
Sep 09 21:33:08.753012 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:08.752935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-b5lwk_65bfa231-6570-48eb-99ff-723ad77a2cf5/openshift-state-metrics/0.log"
Sep 09 21:33:09.169134 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.169103    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-755c8_eac9db12-6af9-4d19-8d76-692b77b243cf/prometheus-operator/0.log"
Sep 09 21:33:09.202082 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.202048    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-755c8_eac9db12-6af9-4d19-8d76-692b77b243cf/kube-rbac-proxy/0.log"
Sep 09 21:33:09.385283 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.385258    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d5575578-n9bw2_7b7a2ace-1e1d-4e77-a090-c51e860a8ab6/thanos-query/0.log"
Sep 09 21:33:09.431860 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.431108    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d5575578-n9bw2_7b7a2ace-1e1d-4e77-a090-c51e860a8ab6/kube-rbac-proxy-web/0.log"
Sep 09 21:33:09.476975 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.476935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d5575578-n9bw2_7b7a2ace-1e1d-4e77-a090-c51e860a8ab6/kube-rbac-proxy/0.log"
Sep 09 21:33:09.512593 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.512565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d5575578-n9bw2_7b7a2ace-1e1d-4e77-a090-c51e860a8ab6/prom-label-proxy/0.log"
Sep 09 21:33:09.544596 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.544562    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d5575578-n9bw2_7b7a2ace-1e1d-4e77-a090-c51e860a8ab6/kube-rbac-proxy-rules/0.log"
Sep 09 21:33:09.570429 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:09.570399    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d5575578-n9bw2_7b7a2ace-1e1d-4e77-a090-c51e860a8ab6/kube-rbac-proxy-metrics/0.log"
Sep 09 21:33:11.025460 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.025431    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:33:11.026424 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:33:11.026395    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:33:11.334490 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.334403    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"]
Sep 09 21:33:11.340849 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.340824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.354140 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.354074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"]
Sep 09 21:33:11.413867 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.413839    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:33:11.426154 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.426042    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/3.log"
Sep 09 21:33:11.487595 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.487551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-sys\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.487842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.487630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-proc\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.487842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.487672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flqc2\" (UniqueName: \"kubernetes.io/projected/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-kube-api-access-flqc2\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.487842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.487722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-podres\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.487842 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.487760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-lib-modules\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589270 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-sys\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589270 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-proc\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589510 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flqc2\" (UniqueName: \"kubernetes.io/projected/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-kube-api-access-flqc2\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589510 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-podres\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589510 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-lib-modules\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-lib-modules\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-sys\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.589669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.589625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-proc\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.590024 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.590002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-podres\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.603855 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.603827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flqc2\" (UniqueName: \"kubernetes.io/projected/3edb2cfb-9c20-47de-a11a-8a28f3b8537f-kube-api-access-flqc2\") pod \"perf-node-gather-daemonset-8ptcg\" (UID: \"3edb2cfb-9c20-47de-a11a-8a28f3b8537f\") " pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.654623 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.654589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:11.954711 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:11.954683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"]
Sep 09 21:33:12.013395 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:12.013359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg" event={"ID":"3edb2cfb-9c20-47de-a11a-8a28f3b8537f","Type":"ContainerStarted","Data":"05f6f6f5e016b3cf5e56c179fec3959acddae22b6d7e0d02334db727795bf21b"}
Sep 09 21:33:12.025561 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:12.025513    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:33:12.026013 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:33:12.025729    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:33:12.110669 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:12.110634    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54c65cc4f5-2nxf2_6636cbd4-3bb1-47ae-8462-88e87430ee89/console/0.log"
Sep 09 21:33:12.184986 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:12.184952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-thhcz_edd1a462-d99e-4b97-b3a6-a28fa975d151/download-server/0.log"
Sep 09 21:33:12.966508 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:12.966482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-8fbfd_5ba6709f-09a7-4f65-95db-16d50859906e/volume-data-source-validator/0.log"
Sep 09 21:33:13.022319 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:13.022276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg" event={"ID":"3edb2cfb-9c20-47de-a11a-8a28f3b8537f","Type":"ContainerStarted","Data":"7cba6c5a12a269eebd48592a1941c57d8adf637db893e7ffc1a5c30b84255c55"}
Sep 09 21:33:13.022512 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:13.022488    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:13.045889 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:13.045830    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg" podStartSLOduration=2.045811061 podStartE2EDuration="2.045811061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:33:13.04462232 +0000 UTC m=+1496.520315328" watchObservedRunningTime="2026-09-09 21:33:13.045811061 +0000 UTC m=+1496.521504057"
Sep 09 21:33:14.027227 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:14.027199    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:33:14.027425 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:33:14.027405    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"
Sep 09 21:33:14.121100 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:14.121076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6n25h_24873d71-47c5-4f54-8514-6a45b864864e/dns/0.log"
Sep 09 21:33:14.147619 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:14.147576    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6n25h_24873d71-47c5-4f54-8514-6a45b864864e/kube-rbac-proxy/0.log"
Sep 09 21:33:14.260596 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:14.260565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hhpzm_9b35cf4a-843a-4f93-863b-a58b691a0160/dns-node-resolver/0.log"
Sep 09 21:33:14.972305 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:14.972273    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dhhk5_3b7c6098-17b4-46a2-b8ee-570590c8f867/node-ca/0.log"
Sep 09 21:33:16.159124 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:16.159099    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-v668w_d16b6a9a-b4ba-4d77-82b3-2352b861281d/kube-auth-proxy/0.log"
Sep 09 21:33:16.390540 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:16.390498    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5589f67c66-9ztht_3c915d66-6764-4ea7-8ffe-c4a5f10ae579/router/0.log"
Sep 09 21:33:17.024685 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:17.024639    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:33:17.026740 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:17.026716    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-x4w78_80682f72-2926-44f1-bb38-2047d487fabc/console-operator/2.log"
Sep 09 21:33:17.113131 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:17.113085    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6njgl_f891665c-6986-421c-9bd8-3f482c2dbebf/serve-healthcheck-canary/0.log"
Sep 09 21:33:17.792728 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:17.792702    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqqd2_82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396/kube-rbac-proxy/0.log"
Sep 09 21:33:17.828101 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:17.828078    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqqd2_82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396/exporter/0.log"
Sep 09 21:33:17.858829 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:17.858795    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqqd2_82ccfeaa-9c9c-45f6-8eb4-0ebec5b9b396/extractor/0.log"
Sep 09 21:33:19.039664 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:19.039631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gc6bv/perf-node-gather-daemonset-8ptcg"
Sep 09 21:33:20.574861 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:20.574833    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-l8r85_c1d090e4-9652-4cda-9fab-de7ec028b0b6/manager/0.log"
Sep 09 21:33:20.611891 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:20.611808    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79ffd8f657-l8r85_c1d090e4-9652-4cda-9fab-de7ec028b0b6/copy-manifests/0.log"
Sep 09 21:33:22.020971 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:22.020942    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-v668w_d16b6a9a-b4ba-4d77-82b3-2352b861281d/kube-auth-proxy/0.log"
Sep 09 21:33:22.025488 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:22.025465    2580 scope.go:117] "RemoveContainer" containerID="b5be6759c3ec3abfcee5731b3446554b1afc8e63d0a5a752ca3e24446271c49e"
Sep 09 21:33:22.025715 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:33:22.025693    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gthhs_llm(32ce4bfe-03cf-4128-be59-0fa52e970e06)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gthhs" podUID="32ce4bfe-03cf-4128-be59-0fa52e970e06"
Sep 09 21:33:22.060231 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:22.060195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56b8fc5c8c-bwcw6_b33325c7-5f5d-4494-a58f-364691635ad8/manager/0.log"
Sep 09 21:33:22.173233 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:22.173209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5589f67c66-9ztht_3c915d66-6764-4ea7-8ffe-c4a5f10ae579/router/0.log"
Sep 09 21:33:23.514582 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:23.514555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6679dddbff-v668w_d16b6a9a-b4ba-4d77-82b3-2352b861281d/kube-auth-proxy/0.log"
Sep 09 21:33:23.610762 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:23.610738    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5589f67c66-9ztht_3c915d66-6764-4ea7-8ffe-c4a5f10ae579/router/0.log"
Sep 09 21:33:26.025774 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:26.025743    2580 scope.go:117] "RemoveContainer" containerID="b4c99be5fc46cf84264dbb1be06faa7f6f5d5aac8e9407d6d868bdc5fafa50e8"
Sep 09 21:33:26.026187 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:33:26.025941    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2_llm(e546027f-f0c3-4c36-817b-85d671507427)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-x99k2" podUID="e546027f-f0c3-4c36-817b-85d671507427"
Sep 09 21:33:27.027949 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:27.027890    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:33:28.118566 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:28.118525    2580 generic.go:356] "Generic (PLEG): container finished" podID="97407490-d41c-4d8b-a17c-54edb736bd6e" containerID="8e57d355a6c175111704cf6b500e0e99e58f43f145a4677edfede51a245560fa" exitCode=0
Sep 09 21:33:28.118566 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:28.118554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" event={"ID":"97407490-d41c-4d8b-a17c-54edb736bd6e","Type":"ContainerDied","Data":"8e57d355a6c175111704cf6b500e0e99e58f43f145a4677edfede51a245560fa"}
Sep 09 21:33:28.119145 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:28.118632    2580 scope.go:117] "RemoveContainer" containerID="1848fb53e8927b1f75081db6ede22672bbda352172ba5df3a48af801a2bf8d5c"
Sep 09 21:33:28.119145 ip-10-0-141-64 kubenswrapper[2580]: I0909 21:33:28.119063    2580 scope.go:117] "RemoveContainer" containerID="8e57d355a6c175111704cf6b500e0e99e58f43f145a4677edfede51a245560fa"
Sep 09 21:33:28.119300 ip-10-0-141-64 kubenswrapper[2580]: E0909 21:33:28.119278    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-wc4ss_llm(97407490-d41c-4d8b-a17c-54edb736bd6e)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-wc4ss" podUID="97407490-d41c-4d8b-a17c-54edb736bd6e"