Jul 23 16:13:34.324422 ip-10-0-131-182 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 16:13:34.324434 ip-10-0-131-182 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 16:13:34.324441 ip-10-0-131-182 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 16:13:34.324806 ip-10-0-131-182 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 16:13:44.573835 ip-10-0-131-182 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 16:13:44.573856 ip-10-0-131-182 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 96750f947b1043aea27ad5cc905c53c4 --
Jul 23 16:15:44.694958 ip-10-0-131-182 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.065090    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071573    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071590    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071594    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071597    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071600    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071603    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071606    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:47.133586 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071609    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071612    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071614    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071617    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071620    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071622    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071625    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071628    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071630    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071633    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071635    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071637    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071642    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071648    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071651    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071654    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071657    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071660    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071664    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071667    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:47.134720 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071670    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071672    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071675    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071678    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071681    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071684    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071687    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071690    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071693    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071695    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071698    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071700    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071704    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071707    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071709    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071711    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071714    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071716    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071718    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071721    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:47.135294 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071724    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071726    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071729    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071732    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071735    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071737    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071740    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071743    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071746    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071748    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071751    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071754    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071757    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071759    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071763    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071766    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071768    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071771    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071774    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:47.136024 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071776    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071779    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071781    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071784    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071787    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071789    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071792    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071794    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071797    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071799    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071802    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071804    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071807    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071809    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071812    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071815    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071817    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071820    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071822    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:47.136556 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071825    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071829    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071832    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071834    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071837    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071841    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071857    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071860    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071865    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071868    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071871    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071874    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071878    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.071881    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072613    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072620    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072623    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072626    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072629    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:47.139539 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072632    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072635    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072638    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072640    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072643    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072646    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072648    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072651    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072655    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072659    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072662    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072665    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072668    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072672    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072676    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072679    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072682    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072686    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072689    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:47.140249 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072692    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072694    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072697    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072699    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072710    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072713    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072716    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072718    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072721    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072723    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072726    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072729    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072731    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072734    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072736    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072739    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072741    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072744    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072746    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072749    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:47.143303 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072752    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072755    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072758    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072760    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072763    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072765    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072768    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072770    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072773    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072776    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072780    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072783    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072786    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072788    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072791    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072793    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072796    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072798    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072801    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:47.144147 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072804    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072806    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072808    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072811    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072814    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072817    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072819    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072822    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072824    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072827    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072829    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072832    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072835    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072837    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072840    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072863    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072866    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072869    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072872    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072874    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:47.144775 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072877    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072879    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072882    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072885    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072891    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072895    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072898    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072901    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072904    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072906    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072909    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072912    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072914    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072917    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072920    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.072922    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075147    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075165    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075171    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075176    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:47.232783 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075182    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:47.158474 ip-10-0-131-182 systemd[1]: Started Kubernetes Kubelet.
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075187    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075198    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075209    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075214    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075218    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075223    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075228    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075235    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075240    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075245    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075250    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075255    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075260    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075269    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075277    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075284    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075289    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075293    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:47.233591 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075297    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075301    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075305    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075310    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075314    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075318    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075323    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075331    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075336    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075340    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075344    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075349    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075353    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075358    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075363    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075367    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075373    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075378    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075382    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:47.234200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075390    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075394    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075398    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075403    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075407    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075412    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075415    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075420    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075424    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075428    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075433    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075438    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075442    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075450    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075454    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075511    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075516    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075519    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075523    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075527    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:47.236396 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075530    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075533    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075536    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075539    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075542    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075546    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075552    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075555    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075558    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075562    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075565    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075568    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075571    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075573    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075579    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075582    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075586    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075589    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075595    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075598    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:47.237349 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075601    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075604    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075607    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075612    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075617    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075621    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075627    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075632    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075635    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075638    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075641    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075646    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075649    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075652    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075655    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075657    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.075660    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075752    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075759    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075767    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075782    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 16:15:47.240485 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075801    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075805    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075814    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075819    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075822    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075825    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075830    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075833    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075837    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075840    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075860    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075864    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075867    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075872    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075877    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075881    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075885    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075888    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075892    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075898    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075902    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075905    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075909    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075912    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 16:15:47.241135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075915    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075918    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075922    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075928    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075933    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075937    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075941    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075946    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075953    2582 flags.go:64] FLAG: --enable-server="true"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075958    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075964    2582 flags.go:64] FLAG: --event-burst="100"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075967    2582 flags.go:64] FLAG: --event-qps="50"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075973    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075976    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075980    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075985    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075988    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075991    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075996    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.075999    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076005    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076009    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076012    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076015    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076019    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 16:15:47.244888 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076022    2582 flags.go:64] FLAG: --feature-gates=""
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076029    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076032    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076038    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076041    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076044    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076048    2582 flags.go:64] FLAG: --help="false"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076051    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076054    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076057    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076061    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076064    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076070    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076074    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076077    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076081    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076084    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076088    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076091    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076094    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076097    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076106    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076112    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076122    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 16:15:47.245833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076125    2582 flags.go:64] FLAG: --lock-file=""
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076128    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076131    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076135    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076142    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076147    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076151    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076154    2582 flags.go:64] FLAG: --logging-format="text"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076160    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076165    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076169    2582 flags.go:64] FLAG: --manifest-url=""
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076172    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076177    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076182    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076187    2582 flags.go:64] FLAG: --max-pods="110"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076190    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076194    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076197    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076200    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076203    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076206    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076209    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076220    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076225    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076228    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 16:15:47.332764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076232    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076235    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076241    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076244    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076251    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076254    2582 flags.go:64] FLAG: --port="10250"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076257    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076261    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-070b5caf0d0eb2a4b"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076265    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076271    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076276    2582 flags.go:64] FLAG: --register-node="true"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076280    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076287    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076291    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076294    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076297    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076304    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076308    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076311    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076314    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076317    2582 flags.go:64] FLAG: --runonce="false"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076322    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076325    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076329    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076332    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 16:15:47.334360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076335    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076338    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076341    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076345    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076350    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076353    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076358    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076362    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076365    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076368    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076372    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076381    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076384    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076387    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076392    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076395    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076398    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076401    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076404    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076407    2582 flags.go:64] FLAG: --v="2"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076414    2582 flags.go:64] FLAG: --version="false"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076419    2582 flags.go:64] FLAG: --vmodule=""
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076424    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.076431    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076664    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:47.335212 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076669    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076672    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076675    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076678    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076681    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076684    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076687    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076692    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076696    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076698    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076701    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076712    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076714    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076719    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076722    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076724    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076727    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076730    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076733    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076737    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:47.336424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076742    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076745    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076750    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076754    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076759    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076769    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076772    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076775    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076777    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076780    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076785    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076788    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076794    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076797    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076799    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076802    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076805    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076807    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076810    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076813    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:47.337054 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076815    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076818    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076821    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076824    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076826    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076833    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076836    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076839    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076841    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076856    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076859    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076862    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076865    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076868    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076871    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076874    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076877    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076882    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076885    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076888    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:47.337875 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076890    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076893    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076897    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076900    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076903    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076907    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076911    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076915    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076919    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076929    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076937    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076940    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076943    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076945    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076948    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076951    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076954    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076959    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076961    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:47.338465 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076964    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076968    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076972    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076978    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076980    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076983    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076987    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076991    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076994    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.076997    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077000    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077003    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077005    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077008    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077011    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077018    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077021    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077025    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:47.339647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.077029    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.078297    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.085704    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.085724    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.085746    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.085755    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085859    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085868    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085873    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085877    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085881    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085884    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085887    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085890    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085893    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:47.341584 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085895    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085898    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085901    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085903    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085906    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085910    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085914    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085917    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085920    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085923    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085926    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085928    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085932    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085935    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085938    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085941    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085944    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085946    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085949    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085952    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:47.342656 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085954    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085957    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085960    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085962    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085965    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085968    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085971    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085973    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085976    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085978    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085981    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085983    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085986    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085989    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085991    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085994    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085996    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.085999    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086001    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086004    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:47.343254 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086007    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086009    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086011    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086014    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086017    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086020    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086023    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086025    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086029    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086033    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086036    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086039    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086041    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086044    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086047    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086049    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086052    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086054    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086057    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:47.343727 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086059    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086062    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086065    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086067    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086070    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086072    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086075    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086077    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086080    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086082    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086085    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086088    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086091    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086093    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086096    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086098    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086101    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086104    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086107    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086109    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:47.344235 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086112    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086115    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086118    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086120    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086123    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086126    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086128    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086131    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086133    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086137    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086142    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.086148    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086265    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086271    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086275    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:47.344738 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086278    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086281    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086284    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086286    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086289    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086292    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086294    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086297    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086300    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086302    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086305    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086307    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086310    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086313    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086316    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086318    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086321    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086324    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086327    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086329    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:47.345200 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086332    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086334    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086337    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086339    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086341    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086344    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086347    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086349    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086352    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086355    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086358    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086360    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086366    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086368    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086371    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086375    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086379    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086385    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086389    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:47.346049 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086392    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086395    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086398    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086401    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086405    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086407    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086410    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086413    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086416    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086418    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086421    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086424    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086427    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086429    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086432    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086434    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086437    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086439    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086442    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086445    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:47.346774 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086447    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086449    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086454    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086458    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086461    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086467    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086470    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086472    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086475    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086478    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086482    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086485    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086487    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086490    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086492    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086495    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086497    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086500    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086503    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:47.347553 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086505    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086508    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086510    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086513    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086516    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086518    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086521    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086523    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086526    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086529    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086531    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086534    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086536    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086539    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086541    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086544    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086548    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:47.348246 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:47.086550    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.086556    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.086699    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.094701    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.096149    2582 server.go:1019] "Starting client certificate rotation"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.096253    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.097099    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.098876    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.100120    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.112943    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.115074    2582 log.go:25] "Validated CRI v1 image API"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.115882    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 16:15:47.348659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.118526    2582 fs.go:135] Filesystem UUIDs: map[541adb8c-c284-41fa-848a-3d9c1a96a6b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ba631b9c-aeeb-4d59-a1e6-f646bce525e0:/dev/nvme0n1p4]
Jul 23 16:15:47.348995 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.118550    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.137981    2582 manager.go:216] Machine: {Timestamp:2026-07-23 16:15:47.136614753 +0000 UTC m=+0.541982001 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097522 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289c016c35c1c2fae8373c48e38cdd SystemUUID:ec289c01-6c35-c1c2-fae8-373c48e38cdd BootID:96750f94-7b10-43ae-a27a-d5cc905c53c4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:44:c0:69:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:44:c0:69:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:1d:24:93:e6:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.138098    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.138250    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.139216    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.139252    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.140474    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.140488    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 16:15:47.349029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.140496    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.141283    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.142527    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.145710    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.145832    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146433    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146444    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146459    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146470    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146479    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146881    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.146898    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.149097    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.151041    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.151069    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152255    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152272    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152280    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152292    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152309    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152321    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152331    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152336    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152345    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152352    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152363    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.152370    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.153146    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.153154    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.154425    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.156307    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.156324    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.156379    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.156807    2582 server.go:1268] "Started kubelet"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.157104    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.157209    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.157262    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.158900    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 16:15:47.349267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.159213    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.161663    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-182.ec2.internal.18c4f760ba1a8414  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-182.ec2.internal,UID:ip-10-0-131-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-182.ec2.internal,},FirstTimestamp:2026-07-23 16:15:47.156780052 +0000 UTC m=+0.562147303,LastTimestamp:2026-07-23 16:15:47.156780052 +0000 UTC m=+0.562147303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-182.ec2.internal,}"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.163487    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.164976    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.165422    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.250037    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250765    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250786    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250803    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250840    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tvw28"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250876    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tvw28"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250989    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.250997    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.251716    2582 factory.go:55] Registering systemd factory
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.251732    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.252003    2582 factory.go:153] Registering CRI-O factory
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.252015    2582 factory.go:223] Registration of the crio container factory successfully
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.252074    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.252099    2582 factory.go:103] Registering Raw factory
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.252109    2582 manager.go:1196] Started watching for new ooms in manager
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.252561    2582 manager.go:349] Starting recovery of all containers
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.252893    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.253054    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.261169    2582 manager.go:354] Recovery completed
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.265102    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267137    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267169    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267179    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267760    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267773    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267765    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.267793    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 16:15:47.350247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.268460    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.268486    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.268501    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.268995    2582 policy_none.go:49] "None policy: Start"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.269017    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.269027    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.270022    2582 policy_none.go:47] "Start"
Jul 23 16:15:47.351208 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.351004    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.434587 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.434565    2582 manager.go:337] "Starting Device Plugin manager"
Jul 23 16:15:47.434719 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.434604    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 16:15:47.434719 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.434614    2582 server.go:87] "Starting device plugin registration server"
Jul 23 16:15:47.434925 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.434912    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 16:15:47.434982 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.434928    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 16:15:47.435084 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.435066    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 16:15:47.435175 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.435163    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 16:15:47.435221 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.435176    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 16:15:47.435656 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.435636    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 16:15:47.435732 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.435685    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.460692 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.460659    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-182.ec2.internal\" not found" node="ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.536116 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.536081    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.537261 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.537245    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.537322 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.537278    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.537322 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.537289    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.537322 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.537316    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.545621 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.545602    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.545710 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.545630    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-182.ec2.internal\": node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.566255 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.566224    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.585011 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.584971    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 16:15:47.586267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.586246    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 16:15:47.586360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.586298    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 16:15:47.586360 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.586325    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 16:15:47.586442 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.586367    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 16:15:47.589763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.589735    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:47.666831 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.666739    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.686937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.686900    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"]
Jul 23 16:15:47.687021 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.686998    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.688603 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.688586    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.688689 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.688617    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.688689 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.688632    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.690040 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690027    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.690148 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.690184 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690167    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.690811 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690796    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.690899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690823    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.690899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690833    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.690899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690798    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.690899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690882    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.690899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.690892    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.691998 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.691985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.692047 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.692009    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:47.692728 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.692709    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:47.692798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.692741    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:47.692798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.692754    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:47.720699 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.720678    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-182.ec2.internal\" not found" node="ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.725201 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.725182    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-182.ec2.internal\" not found" node="ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.753015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.752976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd5e114d9c8200fb17ee0d48adbdc13d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"cd5e114d9c8200fb17ee0d48adbdc13d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.753015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.753014    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/285fdc3c55c4d1cf1192c9e1a0b3d059-config\") pod \"kube-apiserver-proxy-ip-10-0-131-182.ec2.internal\" (UID: \"285fdc3c55c4d1cf1192c9e1a0b3d059\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.753223 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.753037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd5e114d9c8200fb17ee0d48adbdc13d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"cd5e114d9c8200fb17ee0d48adbdc13d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.767040 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.767013    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.853634 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.853592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd5e114d9c8200fb17ee0d48adbdc13d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"cd5e114d9c8200fb17ee0d48adbdc13d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.853634 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.853630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd5e114d9c8200fb17ee0d48adbdc13d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"cd5e114d9c8200fb17ee0d48adbdc13d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.853837 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.853649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/285fdc3c55c4d1cf1192c9e1a0b3d059-config\") pod \"kube-apiserver-proxy-ip-10-0-131-182.ec2.internal\" (UID: \"285fdc3c55c4d1cf1192c9e1a0b3d059\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.853837 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.853701    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/285fdc3c55c4d1cf1192c9e1a0b3d059-config\") pod \"kube-apiserver-proxy-ip-10-0-131-182.ec2.internal\" (UID: \"285fdc3c55c4d1cf1192c9e1a0b3d059\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.853837 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.853707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd5e114d9c8200fb17ee0d48adbdc13d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"cd5e114d9c8200fb17ee0d48adbdc13d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.853837 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:47.853707    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd5e114d9c8200fb17ee0d48adbdc13d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"cd5e114d9c8200fb17ee0d48adbdc13d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:47.867755 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.867716    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:47.968276 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:47.968199    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:48.023376 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.023349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:48.028325 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.028305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:48.068604 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:48.068563    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:48.095785 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.095726    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 16:15:48.095976 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.095937    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 16:15:48.169128 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:48.169099    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:48.216401 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.216374    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:48.255409 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.255338    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 16:10:47 +0000 UTC" deadline="2028-04-15 00:55:11.222561278 +0000 UTC"
Jul 23 16:15:48.255409 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.255372    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15152h39m22.967192696s"
Jul 23 16:15:48.269581 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:48.269557    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:48.330251 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.330225    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:48.369826 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:48.369787    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:48.470542 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:48.470508    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found"
Jul 23 16:15:48.549409 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.549344    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:48.550219 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.550203    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:48.560389 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.560368    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 16:15:48.561658 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.561638    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"
Jul 23 16:15:48.572735 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.572708    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 16:15:48.675404 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:48.675366    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5e114d9c8200fb17ee0d48adbdc13d.slice/crio-e4c7c946ad2f9093d0574de87143d8465b9708a6d8fc73a97de651767e70e533 WatchSource:0}: Error finding container e4c7c946ad2f9093d0574de87143d8465b9708a6d8fc73a97de651767e70e533: Status 404 returned error can't find the container with id e4c7c946ad2f9093d0574de87143d8465b9708a6d8fc73a97de651767e70e533
Jul 23 16:15:48.676003 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:48.675981    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285fdc3c55c4d1cf1192c9e1a0b3d059.slice/crio-7ff29537037078cf42b0e57da55a324473e9db8caff69594afe171b4c17db4c4 WatchSource:0}: Error finding container 7ff29537037078cf42b0e57da55a324473e9db8caff69594afe171b4c17db4c4: Status 404 returned error can't find the container with id 7ff29537037078cf42b0e57da55a324473e9db8caff69594afe171b4c17db4c4
Jul 23 16:15:48.680326 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.680312    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:15:48.944720 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:48.944625    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:49.147831 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.147797    2582 apiserver.go:52] "Watching apiserver"
Jul 23 16:15:49.160419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.160387    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 16:15:49.161461 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.161437    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-vq7nc","openshift-multus/multus-7jljb","openshift-network-diagnostics/network-check-target-4g9nc","openshift-network-operator/iptables-alerter-88mhh","kube-system/global-pull-secret-syncer-k5chr","kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nqs82","openshift-dns/node-resolver-9ptqc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal","openshift-multus/multus-additional-cni-plugins-hscb4","openshift-multus/network-metrics-daemon-lmvfs","openshift-ovn-kubernetes/ovnkube-node-fxpff","kube-system/konnectivity-agent-m2n84","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"]
Jul 23 16:15:49.163636 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.163614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.165319 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.165300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.166516 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.166499    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:49.166586 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.166566    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:15:49.167595 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.167577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.168865 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.168828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.168951 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.168929    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:15:49.170232 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.170215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.170723 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.170529    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.171340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.171434 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171404    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.171520 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171496    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p29wf\""
Jul 23 16:15:49.171583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 16:15:49.171694 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171661    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fnw2j\""
Jul 23 16:15:49.171786 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171749    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.171871 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.171788    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 16:15:49.172027 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.172011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fllwt\""
Jul 23 16:15:49.172583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.172533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.172682 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.172608    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 16:15:49.172682 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.172622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.172682 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.172644    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 16:15:49.172865 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.172783    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.173132 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.173117    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mmtkj\""
Jul 23 16:15:49.174037 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.174024    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.175161 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.175146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8fll\""
Jul 23 16:15:49.175358 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.175345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.175432 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.175378    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.175483 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.175428    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.176613 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.176592    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.176689 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.176645    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.176891 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.176828    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.176891 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.176879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.177094 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.176954    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:15:49.177094 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.177031    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 16:15:49.177166 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.177033    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fddlj\""
Jul 23 16:15:49.177198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.177185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j9c6v\""
Jul 23 16:15:49.177256 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.177237    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 16:15:49.177868 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.177741    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 16:15:49.177868 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.177802    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.178077 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.178059    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 16:15:49.178220 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.178204    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.178356 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.178339    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.179158 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.179133    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 16:15:49.180129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.180111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgl72\""
Jul 23 16:15:49.181010 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.180991    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w6czs\""
Jul 23 16:15:49.181010 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.181004    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 16:15:49.181151 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.180993    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 16:15:49.181906 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.181886    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 16:15:49.181906 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.181900    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 16:15:49.182029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.181890    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 16:15:49.182301 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.182285    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 16:15:49.250478 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.250441    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 16:15:49.251716 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.251690    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 16:15:49.261568 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-run-netns\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.261700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-env-overrides\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.261700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovnkube-script-lib\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.261700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a097974-b19b-484d-9f90-87219b28a6e1-host-slash\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.261700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovn-node-metrics-cert\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.261700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6149737f-227d-43a9-aac4-488a39f01121-dbus\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.261700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-registration-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261760    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-conf-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-systemd\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a097974-b19b-484d-9f90-87219b28a6e1-iptables-alerter-script\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-cni-bin\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-sys-fs\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.261964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-daemon-config\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.261981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67ffc890-e228-44a1-be71-13bf66940594-konnectivity-ca\") pod \"konnectivity-agent-m2n84\" (UID: \"67ffc890-e228-44a1-be71-13bf66940594\") " pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-os-release\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdfj\" (UniqueName: \"kubernetes.io/projected/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-kube-api-access-smdfj\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysctl-conf\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-sys\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d3666bc-4c89-4005-8001-76d81a38f6af-host\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-cni-netd\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-run\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md7c2\" (UniqueName: \"kubernetes.io/projected/8d3666bc-4c89-4005-8001-76d81a38f6af-kube-api-access-md7c2\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovnkube-config\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-kubelet\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.262340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-kubernetes\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67ffc890-e228-44a1-be71-13bf66940594-agent-certs\") pod \"konnectivity-agent-m2n84\" (UID: \"67ffc890-e228-44a1-be71-13bf66940594\") " pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-var-lib-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8kh\" (UniqueName: \"kubernetes.io/projected/253f0b37-e56a-460e-be43-2ce4ee34b7d0-kube-api-access-ts8kh\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-tmp-dir\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-cnibin\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-k8s-cni-cncf-io\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-var-lib-kubelet\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de0cd48f-665a-4138-9ffc-87a2761209ff-tmp\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-socket-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvnl\" (UniqueName: \"kubernetes.io/projected/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-kube-api-access-7pvnl\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-multus-certs\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysctl-d\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.262820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-host\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262670    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjwfk\" (UniqueName: \"kubernetes.io/projected/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-kube-api-access-kjwfk\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-device-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5996\" (UniqueName: \"kubernetes.io/projected/4a097974-b19b-484d-9f90-87219b28a6e1-kube-api-access-d5996\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-hostroot\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-etc-kubernetes\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-modprobe-d\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d3666bc-4c89-4005-8001-76d81a38f6af-serviceca\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-etc-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-node-log\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-os-release\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-netns\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xhnn\" (UniqueName: \"kubernetes.io/projected/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-kube-api-access-7xhnn\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgkqv\" (UniqueName: \"kubernetes.io/projected/de0cd48f-665a-4138-9ffc-87a2761209ff-kube-api-access-xgkqv\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.262992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6149737f-227d-43a9-aac4-488a39f01121-kubelet-config\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-slash\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-systemd\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-system-cni-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-cni-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cnibin\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-cni-binary-copy\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-cni-multus\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-lib-modules\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-systemd-units\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.263866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-log-socket\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-cni-bin\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysconfig\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-tuned\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgqcq\" (UniqueName: \"kubernetes.io/projected/f298e161-3b25-4171-8967-f638931ba2fb-kube-api-access-dgqcq\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-kubelet\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-ovn\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-hosts-file\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-socket-dir-parent\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.264311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.263541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-system-cni-dir\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.297418 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.297381    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ljfqg"
Jul 23 16:15:49.304064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.304036    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ljfqg"
Jul 23 16:15:49.363890 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.363841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-system-cni-dir\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.363890 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.363890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-run-netns\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.363927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-env-overrides\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.363949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-system-cni-dir\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.363953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovnkube-script-lib\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a097974-b19b-484d-9f90-87219b28a6e1-host-slash\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364017    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-run-netns\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovn-node-metrics-cert\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6149737f-227d-43a9-aac4-488a39f01121-dbus\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-registration-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a097974-b19b-484d-9f90-87219b28a6e1-host-slash\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.364135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-registration-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-conf-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-systemd\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a097974-b19b-484d-9f90-87219b28a6e1-iptables-alerter-script\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6149737f-227d-43a9-aac4-488a39f01121-dbus\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-cni-bin\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-cni-bin\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-conf-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-sys-fs\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-systemd\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.364588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-daemon-config\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67ffc890-e228-44a1-be71-13bf66940594-konnectivity-ca\") pod \"konnectivity-agent-m2n84\" (UID: \"67ffc890-e228-44a1-be71-13bf66940594\") " pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-os-release\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdfj\" (UniqueName: \"kubernetes.io/projected/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-kube-api-access-smdfj\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysctl-conf\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-sys\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364540    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364592    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-env-overrides\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d3666bc-4c89-4005-8001-76d81a38f6af-host\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.364492    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-sys-fs\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovnkube-script-lib\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.364733    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:49.864713 +0000 UTC m=+3.270080257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-sys\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.365290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysctl-conf\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-os-release\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364949    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a097974-b19b-484d-9f90-87219b28a6e1-iptables-alerter-script\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.364568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d3666bc-4c89-4005-8001-76d81a38f6af-host\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-cni-netd\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-run\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-daemon-config\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md7c2\" (UniqueName: \"kubernetes.io/projected/8d3666bc-4c89-4005-8001-76d81a38f6af-kube-api-access-md7c2\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67ffc890-e228-44a1-be71-13bf66940594-konnectivity-ca\") pod \"konnectivity-agent-m2n84\" (UID: \"67ffc890-e228-44a1-be71-13bf66940594\") " pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-cni-netd\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovnkube-config\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365206    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-run\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-kubelet\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-kubernetes\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67ffc890-e228-44a1-be71-13bf66940594-agent-certs\") pod \"konnectivity-agent-m2n84\" (UID: \"67ffc890-e228-44a1-be71-13bf66940594\") " pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-var-lib-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8kh\" (UniqueName: \"kubernetes.io/projected/253f0b37-e56a-460e-be43-2ce4ee34b7d0-kube-api-access-ts8kh\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-tmp-dir\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-cnibin\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-k8s-cni-cncf-io\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-kubernetes\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-kubelet\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365418    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-var-lib-kubelet\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-var-lib-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de0cd48f-665a-4138-9ffc-87a2761209ff-tmp\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.366724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-socket-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvnl\" (UniqueName: \"kubernetes.io/projected/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-kube-api-access-7pvnl\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-multus-certs\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysctl-d\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-host\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjwfk\" (UniqueName: \"kubernetes.io/projected/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-kube-api-access-kjwfk\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-device-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5996\" (UniqueName: \"kubernetes.io/projected/4a097974-b19b-484d-9f90-87219b28a6e1-kube-api-access-d5996\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-device-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-multus-certs\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-hostroot\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.367493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-cnibin\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-etc-kubernetes\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365804    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovnkube-config\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-modprobe-d\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d3666bc-4c89-4005-8001-76d81a38f6af-serviceca\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365880    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-k8s-cni-cncf-io\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-etc-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-var-lib-kubelet\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.365975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-node-log\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-os-release\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366012    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-host\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-netns\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xhnn\" (UniqueName: \"kubernetes.io/projected/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-kube-api-access-7xhnn\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgkqv\" (UniqueName: \"kubernetes.io/projected/de0cd48f-665a-4138-9ffc-87a2761209ff-kube-api-access-xgkqv\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6149737f-227d-43a9-aac4-488a39f01121-kubelet-config\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.368139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-slash\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-socket-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-tmp-dir\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366437    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d3666bc-4c89-4005-8001-76d81a38f6af-serviceca\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-hostroot\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-os-release\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366801    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-run-netns\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-systemd\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-systemd\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-system-cni-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-cni-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cnibin\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.368598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysctl-d\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.366963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-cni-binary-copy\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-cni-multus\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6149737f-227d-43a9-aac4-488a39f01121-kubelet-config\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-lib-modules\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cnibin\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-system-cni-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-systemd-units\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-log-socket\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-etc-openvswitch\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-cni-bin\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-node-log\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-etc-kubernetes\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367207    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-slash\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysconfig\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-cni-multus\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-tuned\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.367285    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgqcq\" (UniqueName: \"kubernetes.io/projected/f298e161-3b25-4171-8967-f638931ba2fb-kube-api-access-dgqcq\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.367366    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:15:49.867329363 +0000 UTC m=+3.272696617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367376    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-lib-modules\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-cni-binary-copy\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-modprobe-d\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-kubelet\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-log-socket\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-ovn\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-sysconfig\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/253f0b37-e56a-460e-be43-2ce4ee34b7d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-run-ovn\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367624    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-systemd-units\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-hosts-file\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-socket-dir-parent\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-host-kubelet\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-socket-dir-parent\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-host-var-lib-cni-bin\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367985    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.367917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-hosts-file\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.368098    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-multus-cni-dir\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.368405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de0cd48f-665a-4138-9ffc-87a2761209ff-tmp\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.368445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-ovn-node-metrics-cert\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.369918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.368496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67ffc890-e228-44a1-be71-13bf66940594-agent-certs\") pod \"konnectivity-agent-m2n84\" (UID: \"67ffc890-e228-44a1-be71-13bf66940594\") " pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.370370 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.369800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de0cd48f-665a-4138-9ffc-87a2761209ff-etc-tuned\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.376938 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.376913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md7c2\" (UniqueName: \"kubernetes.io/projected/8d3666bc-4c89-4005-8001-76d81a38f6af-kube-api-access-md7c2\") pod \"node-ca-vq7nc\" (UID: \"8d3666bc-4c89-4005-8001-76d81a38f6af\") " pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.377429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.377411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8kh\" (UniqueName: \"kubernetes.io/projected/253f0b37-e56a-460e-be43-2ce4ee34b7d0-kube-api-access-ts8kh\") pod \"aws-ebs-csi-driver-node-788dj\" (UID: \"253f0b37-e56a-460e-be43-2ce4ee34b7d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.380040 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.380015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdfj\" (UniqueName: \"kubernetes.io/projected/6b1c9ac9-9e99-4c0b-9008-349cac0fdef4-kube-api-access-smdfj\") pod \"multus-additional-cni-plugins-hscb4\" (UID: \"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4\") " pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.384595 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.384409    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:49.384595 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.384433    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:49.384595 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.384447    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:49.384595 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.384505    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:15:49.88448624 +0000 UTC m=+3.289853494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:49.385600 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.385577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgkqv\" (UniqueName: \"kubernetes.io/projected/de0cd48f-665a-4138-9ffc-87a2761209ff-kube-api-access-xgkqv\") pod \"tuned-nqs82\" (UID: \"de0cd48f-665a-4138-9ffc-87a2761209ff\") " pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.385978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.385961    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5996\" (UniqueName: \"kubernetes.io/projected/4a097974-b19b-484d-9f90-87219b28a6e1-kube-api-access-d5996\") pod \"iptables-alerter-88mhh\" (UID: \"4a097974-b19b-484d-9f90-87219b28a6e1\") " pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.386793 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.386763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xhnn\" (UniqueName: \"kubernetes.io/projected/b2cb6d52-21c8-4041-b8d9-c627b74bd57a-kube-api-access-7xhnn\") pod \"multus-7jljb\" (UID: \"b2cb6d52-21c8-4041-b8d9-c627b74bd57a\") " pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.386962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.386941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvnl\" (UniqueName: \"kubernetes.io/projected/8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5-kube-api-access-7pvnl\") pod \"node-resolver-9ptqc\" (UID: \"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5\") " pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.387090 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.387057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjwfk\" (UniqueName: \"kubernetes.io/projected/5cf7742c-3032-4622-adb8-0c6b5cf2edaf-kube-api-access-kjwfk\") pod \"ovnkube-node-fxpff\" (UID: \"5cf7742c-3032-4622-adb8-0c6b5cf2edaf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.389539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.389519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgqcq\" (UniqueName: \"kubernetes.io/projected/f298e161-3b25-4171-8967-f638931ba2fb-kube-api-access-dgqcq\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.473100 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.473010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nqs82"
Jul 23 16:15:49.480261 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.480239    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:15:49.481603 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.481572    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde0cd48f_665a_4138_9ffc_87a2761209ff.slice/crio-3de3cafa7ea3ef0be1774a766679705f9c79803517345a77db44a02efcc8dd8c WatchSource:0}: Error finding container 3de3cafa7ea3ef0be1774a766679705f9c79803517345a77db44a02efcc8dd8c: Status 404 returned error can't find the container with id 3de3cafa7ea3ef0be1774a766679705f9c79803517345a77db44a02efcc8dd8c
Jul 23 16:15:49.487708 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.487675    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88mhh"
Jul 23 16:15:49.487882 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.487859    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ffc890_e228_44a1_be71_13bf66940594.slice/crio-bc3709aedbd7591b96af62ff11197d6dd370c752ed03a19d2eacc89f265662c3 WatchSource:0}: Error finding container bc3709aedbd7591b96af62ff11197d6dd370c752ed03a19d2eacc89f265662c3: Status 404 returned error can't find the container with id bc3709aedbd7591b96af62ff11197d6dd370c752ed03a19d2eacc89f265662c3
Jul 23 16:15:49.492072 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.492047    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj"
Jul 23 16:15:49.495474 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.495447    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a097974_b19b_484d_9f90_87219b28a6e1.slice/crio-13a80993e4ca1eb6f3105d4cd6cde11edfa669d4827ec1c3a2c7b0e6a1b0efb6 WatchSource:0}: Error finding container 13a80993e4ca1eb6f3105d4cd6cde11edfa669d4827ec1c3a2c7b0e6a1b0efb6: Status 404 returned error can't find the container with id 13a80993e4ca1eb6f3105d4cd6cde11edfa669d4827ec1c3a2c7b0e6a1b0efb6
Jul 23 16:15:49.497704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.497683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9ptqc"
Jul 23 16:15:49.501306 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.501280    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253f0b37_e56a_460e_be43_2ce4ee34b7d0.slice/crio-06ee3a4d6f5817973d28c7450cb14bc3b6890ed9d9b41e4bb280fee2a9d6bf21 WatchSource:0}: Error finding container 06ee3a4d6f5817973d28c7450cb14bc3b6890ed9d9b41e4bb280fee2a9d6bf21: Status 404 returned error can't find the container with id 06ee3a4d6f5817973d28c7450cb14bc3b6890ed9d9b41e4bb280fee2a9d6bf21
Jul 23 16:15:49.505224 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.505199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vq7nc"
Jul 23 16:15:49.507139 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.507111    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbec0b4_b5c3_406f_9ef2_50ca8aaa26b5.slice/crio-7bcdf85bcc80cf2ad1eaeeaeb8be0cf86dc4731dcb7dd32678cd129343841b0c WatchSource:0}: Error finding container 7bcdf85bcc80cf2ad1eaeeaeb8be0cf86dc4731dcb7dd32678cd129343841b0c: Status 404 returned error can't find the container with id 7bcdf85bcc80cf2ad1eaeeaeb8be0cf86dc4731dcb7dd32678cd129343841b0c
Jul 23 16:15:49.510009 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.509982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jljb"
Jul 23 16:15:49.514118 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.514090    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3666bc_4c89_4005_8001_76d81a38f6af.slice/crio-35f1aa61ec709b86ee24ef0fd5c06da10e3d590928c8e207a910f592960b408a WatchSource:0}: Error finding container 35f1aa61ec709b86ee24ef0fd5c06da10e3d590928c8e207a910f592960b408a: Status 404 returned error can't find the container with id 35f1aa61ec709b86ee24ef0fd5c06da10e3d590928c8e207a910f592960b408a
Jul 23 16:15:49.515629 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.515607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hscb4"
Jul 23 16:15:49.518766 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.518740    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cb6d52_21c8_4041_b8d9_c627b74bd57a.slice/crio-20839be17518394bf82ca9be8f7bdd4f5b2f3a05b06a38a053aaa1dfb7cddbcb WatchSource:0}: Error finding container 20839be17518394bf82ca9be8f7bdd4f5b2f3a05b06a38a053aaa1dfb7cddbcb: Status 404 returned error can't find the container with id 20839be17518394bf82ca9be8f7bdd4f5b2f3a05b06a38a053aaa1dfb7cddbcb
Jul 23 16:15:49.520239 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.520137    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:15:49.527087 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.527059    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1c9ac9_9e99_4c0b_9008_349cac0fdef4.slice/crio-7f8447bcacae3db461fa082fcd9462634d2b2ca77eed9af1cdd22e026a72ad50 WatchSource:0}: Error finding container 7f8447bcacae3db461fa082fcd9462634d2b2ca77eed9af1cdd22e026a72ad50: Status 404 returned error can't find the container with id 7f8447bcacae3db461fa082fcd9462634d2b2ca77eed9af1cdd22e026a72ad50
Jul 23 16:15:49.532662 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:15:49.532628    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf7742c_3032_4622_adb8_0c6b5cf2edaf.slice/crio-f61118d8d88d338b0a093ff1a489cdfdc6ebf05649cea55d2c4ce3e802ac63a8 WatchSource:0}: Error finding container f61118d8d88d338b0a093ff1a489cdfdc6ebf05649cea55d2c4ce3e802ac63a8: Status 404 returned error can't find the container with id f61118d8d88d338b0a093ff1a489cdfdc6ebf05649cea55d2c4ce3e802ac63a8
Jul 23 16:15:49.591242 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.591193    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerStarted","Data":"7f8447bcacae3db461fa082fcd9462634d2b2ca77eed9af1cdd22e026a72ad50"}
Jul 23 16:15:49.592500 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.592467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jljb" event={"ID":"b2cb6d52-21c8-4041-b8d9-c627b74bd57a","Type":"ContainerStarted","Data":"20839be17518394bf82ca9be8f7bdd4f5b2f3a05b06a38a053aaa1dfb7cddbcb"}
Jul 23 16:15:49.593551 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.593526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9ptqc" event={"ID":"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5","Type":"ContainerStarted","Data":"7bcdf85bcc80cf2ad1eaeeaeb8be0cf86dc4731dcb7dd32678cd129343841b0c"}
Jul 23 16:15:49.594637 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.594614    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m2n84" event={"ID":"67ffc890-e228-44a1-be71-13bf66940594","Type":"ContainerStarted","Data":"bc3709aedbd7591b96af62ff11197d6dd370c752ed03a19d2eacc89f265662c3"}
Jul 23 16:15:49.595695 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.595667    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nqs82" event={"ID":"de0cd48f-665a-4138-9ffc-87a2761209ff","Type":"ContainerStarted","Data":"3de3cafa7ea3ef0be1774a766679705f9c79803517345a77db44a02efcc8dd8c"}
Jul 23 16:15:49.596900 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.596872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"f61118d8d88d338b0a093ff1a489cdfdc6ebf05649cea55d2c4ce3e802ac63a8"}
Jul 23 16:15:49.598153 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.598122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vq7nc" event={"ID":"8d3666bc-4c89-4005-8001-76d81a38f6af","Type":"ContainerStarted","Data":"35f1aa61ec709b86ee24ef0fd5c06da10e3d590928c8e207a910f592960b408a"}
Jul 23 16:15:49.599286 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.599249    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj" event={"ID":"253f0b37-e56a-460e-be43-2ce4ee34b7d0","Type":"ContainerStarted","Data":"06ee3a4d6f5817973d28c7450cb14bc3b6890ed9d9b41e4bb280fee2a9d6bf21"}
Jul 23 16:15:49.600534 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.600511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88mhh" event={"ID":"4a097974-b19b-484d-9f90-87219b28a6e1","Type":"ContainerStarted","Data":"13a80993e4ca1eb6f3105d4cd6cde11edfa669d4827ec1c3a2c7b0e6a1b0efb6"}
Jul 23 16:15:49.601645 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.601625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" event={"ID":"285fdc3c55c4d1cf1192c9e1a0b3d059","Type":"ContainerStarted","Data":"7ff29537037078cf42b0e57da55a324473e9db8caff69594afe171b4c17db4c4"}
Jul 23 16:15:49.602752 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.602717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" event={"ID":"cd5e114d9c8200fb17ee0d48adbdc13d","Type":"ContainerStarted","Data":"e4c7c946ad2f9093d0574de87143d8465b9708a6d8fc73a97de651767e70e533"}
Jul 23 16:15:49.873307 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.873221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:49.873307 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.873285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:49.873496 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.873402    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.873496 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.873432    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:49.873496 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.873469    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:50.873450969 +0000 UTC m=+4.278818221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:49.873496 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.873496    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:15:50.873479062 +0000 UTC m=+4.278846310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:49.974693 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:49.974377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:49.974693 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.974551    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:49.974693 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.974571    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:49.974693 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.974600    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:49.974693 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:49.974664    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:15:50.974645123 +0000 UTC m=+4.380012361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:50.306999 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.306914    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:10:49 +0000 UTC" deadline="2028-03-05 14:08:19.00245444 +0000 UTC"
Jul 23 16:15:50.306999 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.306949    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14181h52m28.695509991s"
Jul 23 16:15:50.588363 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.587397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:50.588363 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.587540    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:15:50.588363 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.587971    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:50.588363 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.588114    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:15:50.588363 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.588185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:50.588363 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.588263    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:15:50.881558 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.881472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:50.881749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.881568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:50.881749 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.881626    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:50.881749 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.881698    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.881680285 +0000 UTC m=+6.287047536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:50.881749 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.881697    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:50.881749 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.881732    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.881722805 +0000 UTC m=+6.287090055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:50.983633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:50.982977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:50.983633 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.983189    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:50.983633 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.983211    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:50.983633 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.983224    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:50.983633 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:50.983284    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.983265464 +0000 UTC m=+6.388632719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:51.307698 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:51.307622    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:10:49 +0000 UTC" deadline="2028-05-09 02:31:27.56125835 +0000 UTC"
Jul 23 16:15:51.307698 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:51.307662    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15730h15m36.25360129s"
Jul 23 16:15:52.586978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:52.586947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:52.587423 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.587081    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:15:52.587423 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:52.587133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:52.587423 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.587223    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:15:52.587423 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:52.586956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:52.587423 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.587301    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:15:52.900308 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:52.900259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:52.900484 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:52.900370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:52.900558 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.900508    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:52.900610 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.900569    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:15:56.900549289 +0000 UTC m=+10.305916532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:52.901207 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.901086    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:52.901207 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:52.901142    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:56.90112678 +0000 UTC m=+10.306494019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:53.001410 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:53.001360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:53.001597 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:53.001567    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:53.001597 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:53.001589    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:53.001698 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:53.001602    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:53.001698 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:53.001666    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:15:57.001647035 +0000 UTC m=+10.407014289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:54.587238 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:54.587204    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:54.587238 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:54.587236    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:54.587894 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:54.587350    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:15:54.587894 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:54.587421    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:15:54.587894 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:54.587472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:54.587894 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:54.587550    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:15:56.587583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:56.587548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:56.588063 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.587682    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:15:56.588063 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:56.587813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:56.588063 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:56.587832    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:56.588063 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.587956    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:15:56.588063 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.588027    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:15:56.936742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:56.936503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:56.936742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:56.936568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:56.936742 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.936671    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:56.936742 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.936719    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:56.937116 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.936761    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:16:04.936741325 +0000 UTC m=+18.342108576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:56.937116 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:56.936785    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:04.93677546 +0000 UTC m=+18.342142703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:57.037669 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:57.037606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:57.037871 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:57.037812    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:57.037871 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:57.037842    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:57.037871 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:57.037872    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:57.038054 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:57.037936    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:16:05.037917168 +0000 UTC m=+18.443284422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:58.586786 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:58.586732    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:15:58.586786 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:58.586732    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:15:58.587311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:15:58.586753    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:15:58.587311 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:58.586898    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:15:58.587311 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:58.587011    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:15:58.587311 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:15:58.587062    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:00.586738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:00.586701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:00.586738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:00.586736    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:00.587151 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:00.586796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:00.587151 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:00.586826    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:00.587151 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:00.586866    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:00.587151 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:00.586934    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:02.587067 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:02.587029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:02.587539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:02.587026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:02.587539 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:02.587160    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:02.587539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:02.587189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:02.587685 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:02.587316    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:02.589924 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:02.588353    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:04.587070 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:04.587035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:04.587513 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:04.587035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:04.587513 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.587158    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:04.587513 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.587263    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:04.587513 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:04.587045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:04.587513 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.587364    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:04.993137 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:04.993102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:04.993346 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:04.993163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:04.993346 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.993268    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:04.993346 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.993325    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:20.99331053 +0000 UTC m=+34.398677766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:04.993511 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.993268    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:04.993511 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:04.993429    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:16:20.993406643 +0000 UTC m=+34.398773895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:05.093529 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:05.093486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:05.093705 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:05.093673    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:16:05.093705 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:05.093699    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:16:05.093837 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:05.093714    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:05.093837 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:05.093780    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:16:21.09376066 +0000 UTC m=+34.499127896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:06.586749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:06.586533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:06.587191 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:06.586570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:06.587191 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:06.586879    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:06.587191 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:06.586588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:06.587191 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:06.586906    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:06.587191 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:06.586974    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:08.587570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:08.587527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:08.588074 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:08.587536    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:08.588074 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:08.587661    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:08.588074 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:08.587536    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:08.588074 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:08.587722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:08.588074 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:08.587795    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:09.643402 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.643215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m2n84" event={"ID":"67ffc890-e228-44a1-be71-13bf66940594","Type":"ContainerStarted","Data":"04bd5bd84fba0e31b25479f7e348174c7b21f288b6ed987ce3523262191ae70b"}
Jul 23 16:16:09.644720 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.644688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nqs82" event={"ID":"de0cd48f-665a-4138-9ffc-87a2761209ff","Type":"ContainerStarted","Data":"756c81d3fbaa6bfd0489547aca98ecfc574bc100ecaf5caf182d7ea54a243aab"}
Jul 23 16:16:09.647446 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.647425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"3e746047261d3c05113a2351cc7641a054c5c243a1ba370542131d134b577769"}
Jul 23 16:16:09.647525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.647496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"2c10554536d94561ba10a092ccce35b3e1a89d50f7c20f418b72761b12e950ca"}
Jul 23 16:16:09.647583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.647530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"cbe4b37850d0fe7cad4d8d19bcdaeaf099d51c6fc85130b3c2dc41f5dcc71e32"}
Jul 23 16:16:09.647583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.647557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"5547ec7629eee9538d22c453745c582c13b6455be35cf787b2f7f2202e9656d4"}
Jul 23 16:16:09.648899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.648877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vq7nc" event={"ID":"8d3666bc-4c89-4005-8001-76d81a38f6af","Type":"ContainerStarted","Data":"9e22b7076a690e7d0b852d94b37c63532ef02fb0b8219c9f35b93939398483d0"}
Jul 23 16:16:09.650357 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.650337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj" event={"ID":"253f0b37-e56a-460e-be43-2ce4ee34b7d0","Type":"ContainerStarted","Data":"4df5261551cd0866bcf575de43552cece2f72fe4cf5f1934319ea64e0d4a3a48"}
Jul 23 16:16:09.651590 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.651568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" event={"ID":"285fdc3c55c4d1cf1192c9e1a0b3d059","Type":"ContainerStarted","Data":"f4ba22fea675e1f8f344fd3abe047ae3ab7c6cdc339e6655fa18c869744b41e6"}
Jul 23 16:16:09.652924 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.652900    2582 generic.go:356] "Generic (PLEG): container finished" podID="cd5e114d9c8200fb17ee0d48adbdc13d" containerID="b8716f05b1cb876f94fc4cd369fb3d2c5d53ab4f899d71a8721e3e8cb0c8b4c8" exitCode=0
Jul 23 16:16:09.653013 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.652968    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" event={"ID":"cd5e114d9c8200fb17ee0d48adbdc13d","Type":"ContainerDied","Data":"b8716f05b1cb876f94fc4cd369fb3d2c5d53ab4f899d71a8721e3e8cb0c8b4c8"}
Jul 23 16:16:09.654300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.654279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerStarted","Data":"e6fbee0025ac51d7e2be15b01adf0ec3e22bfa63476d9b9e6eb20380b4d9b9be"}
Jul 23 16:16:09.655753 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.655731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jljb" event={"ID":"b2cb6d52-21c8-4041-b8d9-c627b74bd57a","Type":"ContainerStarted","Data":"ee36d8e60ea7a0881bf0a3ef344c1b19994308cef9e6665f879268b47816378c"}
Jul 23 16:16:09.657023 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.657002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9ptqc" event={"ID":"8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5","Type":"ContainerStarted","Data":"968312f921f828e3f3af3037642471160b4641271d1e003ec7010deb101a1133"}
Jul 23 16:16:09.674018 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.673970    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nqs82" podStartSLOduration=3.083216608 podStartE2EDuration="22.673949666s" totalImagesPullingTime="19.590733058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.673421001 +0000 UTC m=+23.078788259" watchObservedRunningTime="2026-07-23 16:16:09.673949666 +0000 UTC m=+23.079316979"
Jul 23 16:16:09.694051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.694005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m2n84" podStartSLOduration=3.109332231 podStartE2EDuration="22.693990371s" totalImagesPullingTime="19.58465814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.693162278 +0000 UTC m=+23.098529536" watchObservedRunningTime="2026-07-23 16:16:09.693990371 +0000 UTC m=+23.099357629"
Jul 23 16:16:09.710727 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.710683    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" podStartSLOduration=21.710667565 podStartE2EDuration="21.710667565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.710519903 +0000 UTC m=+23.115887178" watchObservedRunningTime="2026-07-23 16:16:09.710667565 +0000 UTC m=+23.116034823"
Jul 23 16:16:09.726197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.726146    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vq7nc" podStartSLOduration=3.192718262 podStartE2EDuration="22.72612581s" totalImagesPullingTime="19.533407548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.72606262 +0000 UTC m=+23.131429878" watchObservedRunningTime="2026-07-23 16:16:09.72612581 +0000 UTC m=+23.131493068"
Jul 23 16:16:09.811706 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:09.811651    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7jljb" podStartSLOduration=3.06941394 podStartE2EDuration="22.811636021s" totalImagesPullingTime="19.742222081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.755583729 +0000 UTC m=+23.160950988" watchObservedRunningTime="2026-07-23 16:16:09.811636021 +0000 UTC m=+23.217003279"
Jul 23 16:16:10.351276 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.351014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ptqc_8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5/dns-node-resolver/0.log"
Jul 23 16:16:10.587223 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.587188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:10.587400 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.587261    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:10.587400 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.587276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:10.587400 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:10.587361    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:10.587507 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:10.587473    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:10.587559 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:10.587542    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:10.660823 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.660788    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b1c9ac9-9e99-4c0b-9008-349cac0fdef4" containerID="e6fbee0025ac51d7e2be15b01adf0ec3e22bfa63476d9b9e6eb20380b4d9b9be" exitCode=0
Jul 23 16:16:10.661270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.660890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerDied","Data":"e6fbee0025ac51d7e2be15b01adf0ec3e22bfa63476d9b9e6eb20380b4d9b9be"}
Jul 23 16:16:10.663586 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.663563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"17219915aeb0ebc18042cc4009e0cf5b5cea5404efa97c512e8a4475755476e2"}
Jul 23 16:16:10.663695 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.663625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"f5a7fcd455bea9f79e3e951523606df470ac06da57cc468aebce144590ce5769"}
Jul 23 16:16:10.664923 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.664898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88mhh" event={"ID":"4a097974-b19b-484d-9f90-87219b28a6e1","Type":"ContainerStarted","Data":"433afe58509ff340e83db6a71e3e0572673df4d13e18c84f822d814be73054b5"}
Jul 23 16:16:10.685299 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.685247    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9ptqc" podStartSLOduration=4.116160591 podStartE2EDuration="23.685232723s" totalImagesPullingTime="19.569072132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:09.831688155 +0000 UTC m=+23.237055412" watchObservedRunningTime="2026-07-23 16:16:10.685232723 +0000 UTC m=+24.090600050"
Jul 23 16:16:10.704117 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.704064    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-88mhh" podStartSLOduration=4.153161881 podStartE2EDuration="23.704048753s" totalImagesPullingTime="19.550886872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:10.703340591 +0000 UTC m=+24.108707849" watchObservedRunningTime="2026-07-23 16:16:10.704048753 +0000 UTC m=+24.109416010"
Jul 23 16:16:10.876761 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:10.876733    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 16:16:11.448923 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.448789    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T16:16:10.876752655Z","UUID":"eb893457-f147-4ff3-971b-c74fa480cb5d","Handler":null,"Name":"","Endpoint":""}
Jul 23 16:16:11.451672 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.451028    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 16:16:11.451672 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.451075    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 16:16:11.670021 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.669982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj" event={"ID":"253f0b37-e56a-460e-be43-2ce4ee34b7d0","Type":"ContainerStarted","Data":"196e3084448fea39874d7a408c4220e831117d4b97ecf8b4074b3ac88c649132"}
Jul 23 16:16:11.672630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.672586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" event={"ID":"cd5e114d9c8200fb17ee0d48adbdc13d","Type":"ContainerStarted","Data":"518de5b11969eb6e55a34c733526aa16da85937f76c76d6714096e8b0b88b0fd"}
Jul 23 16:16:11.692784 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.692725    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" podStartSLOduration=23.692703852 podStartE2EDuration="23.692703852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:11.691895897 +0000 UTC m=+25.097263158" watchObservedRunningTime="2026-07-23 16:16:11.692703852 +0000 UTC m=+25.098071094"
Jul 23 16:16:11.707957 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:11.707887    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vq7nc_8d3666bc-4c89-4005-8001-76d81a38f6af/node-ca/0.log"
Jul 23 16:16:12.586628 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.586537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:12.586628 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.586568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:12.586628 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.586567    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:12.586959 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:12.586663    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:12.586959 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:12.586751    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:12.586959 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:12.586834    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:12.679083 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.679048    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"86f3d69decace5ec0015d484fe2ae9119f6964b33a38763d29caec95955538ce"}
Jul 23 16:16:12.681643 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.681591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj" event={"ID":"253f0b37-e56a-460e-be43-2ce4ee34b7d0","Type":"ContainerStarted","Data":"b090f94e1c1f5c59719c1bb3554b5b34282294235ce616af9bd617efae721072"}
Jul 23 16:16:12.704518 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.704466    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-788dj" podStartSLOduration=8.370335415 podStartE2EDuration="25.704449937s" totalImagesPullingTime="17.334114522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:12.703493263 +0000 UTC m=+26.108860522" watchObservedRunningTime="2026-07-23 16:16:12.704449937 +0000 UTC m=+26.109817194"
Jul 23 16:16:12.729085 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.729046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:16:12.729808 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:12.729785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:16:14.587586 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:14.587546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:14.588127 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:14.587562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:14.588127 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:14.587546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:14.588127 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:14.587778    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:14.588127 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:14.587671    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:14.588127 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:14.587896    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:15.692282 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.691996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" event={"ID":"5cf7742c-3032-4622-adb8-0c6b5cf2edaf","Type":"ContainerStarted","Data":"b290a56dd581a90542f7ff79ec990d3f5e48beb232b438a1126c0435a4ab690a"}
Jul 23 16:16:15.693020 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.692310    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:16:15.693020 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.692356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:16:15.693924 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.693901    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b1c9ac9-9e99-4c0b-9008-349cac0fdef4" containerID="9ead239a86fb990188d7257e7d1e2eca3f023f54d547ce05de01ebabc478a7db" exitCode=0
Jul 23 16:16:15.694050 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.693933    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerDied","Data":"9ead239a86fb990188d7257e7d1e2eca3f023f54d547ce05de01ebabc478a7db"}
Jul 23 16:16:15.708522 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.708496    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:16:15.725030 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:15.724966    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff" podStartSLOduration=9.164303229 podStartE2EDuration="28.724950291s" totalImagesPullingTime="19.560647062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:15.724540223 +0000 UTC m=+29.129907482" watchObservedRunningTime="2026-07-23 16:16:15.724950291 +0000 UTC m=+29.130317572"
Jul 23 16:16:16.587222 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.587193    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:16.587457 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.587202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:16.587457 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:16.587302    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:16.587457 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.587210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:16.587457 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:16.587350    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:16.587457 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:16.587431    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:16.656936 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.656894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:16:16.657116 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.657039    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 16:16:16.657535 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.657519    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m2n84"
Jul 23 16:16:16.696403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.696366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:16:16.711376 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:16.711349    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:16:17.700094 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:17.700014    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b1c9ac9-9e99-4c0b-9008-349cac0fdef4" containerID="b900986e6b03d7ea72707b16db18915baede8bb8f7856c1a943a4e181a6561cb" exitCode=0
Jul 23 16:16:17.700535 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:17.700097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerDied","Data":"b900986e6b03d7ea72707b16db18915baede8bb8f7856c1a943a4e181a6561cb"}
Jul 23 16:16:18.586993 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:18.586951    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:18.586993 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:18.587000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:18.587262 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:18.587000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:18.587262 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:18.587084    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:18.587262 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:18.587145    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:18.587262 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:18.587215    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:19.707220 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:19.707182    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b1c9ac9-9e99-4c0b-9008-349cac0fdef4" containerID="66aca1e3f6c9f49cbbb102bbdf023c9f0701e9a36f0bfba8693f07bcd93b1f1a" exitCode=0
Jul 23 16:16:19.707630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:19.707229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerDied","Data":"66aca1e3f6c9f49cbbb102bbdf023c9f0701e9a36f0bfba8693f07bcd93b1f1a"}
Jul 23 16:16:20.587010 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:20.586973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:20.587010 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:20.587001    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:20.587260 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:20.587007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:20.587317 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:20.587251    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:20.587363 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:20.587317    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:20.587412 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:20.587376    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:21.020966 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:21.020933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:21.021429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:21.021024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:21.021429 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.021103    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:21.021429 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.021174    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs podName:f298e161-3b25-4171-8967-f638931ba2fb nodeName:}" failed. No retries permitted until 2026-07-23 16:16:53.021156096 +0000 UTC m=+66.426523332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs") pod "network-metrics-daemon-lmvfs" (UID: "f298e161-3b25-4171-8967-f638931ba2fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:16:21.021429 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.021181    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:21.021429 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.021243    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret podName:6149737f-227d-43a9-aac4-488a39f01121 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:53.021225038 +0000 UTC m=+66.426592278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret") pod "global-pull-secret-syncer-k5chr" (UID: "6149737f-227d-43a9-aac4-488a39f01121") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:16:21.122214 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:21.122174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:21.122402 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.122316    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:16:21.122402 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.122340    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:16:21.122402 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.122354    2582 projected.go:196] Error preparing data for projected volume kube-api-access-26924 for pod openshift-network-diagnostics/network-check-target-4g9nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:21.122535 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:21.122413    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924 podName:270050ed-b65d-42e7-a3bb-d449077efc8f nodeName:}" failed. No retries permitted until 2026-07-23 16:16:53.122395696 +0000 UTC m=+66.527762935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-26924" (UniqueName: "kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924") pod "network-check-target-4g9nc" (UID: "270050ed-b65d-42e7-a3bb-d449077efc8f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:16:22.586752 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:22.586715    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:22.587219 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:22.586724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:22.587219 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:22.586828    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:22.587219 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:22.586947    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:22.587219 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:22.586729    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:22.587219 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:22.587065    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:23.720272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:23.720233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerStarted","Data":"83c1b0ee32c7115064c0fd31ff99f7240b3b5fb2e07196e39587d189eda8f856"}
Jul 23 16:16:24.587271 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:24.587234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:24.587271 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:24.587259    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:24.587524 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:24.587346    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:24.587524 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:24.587393    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:24.587524 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:24.587438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:24.587678 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:24.587545    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:24.725037 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:24.725001    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b1c9ac9-9e99-4c0b-9008-349cac0fdef4" containerID="83c1b0ee32c7115064c0fd31ff99f7240b3b5fb2e07196e39587d189eda8f856" exitCode=0
Jul 23 16:16:24.725386 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:24.725056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerDied","Data":"83c1b0ee32c7115064c0fd31ff99f7240b3b5fb2e07196e39587d189eda8f856"}
Jul 23 16:16:25.729931 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:25.729898    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b1c9ac9-9e99-4c0b-9008-349cac0fdef4" containerID="d1953266d88dbfac06563425bb520ac676170f235fd6c800613680d1fe1163f7" exitCode=0
Jul 23 16:16:25.730316 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:25.729947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerDied","Data":"d1953266d88dbfac06563425bb520ac676170f235fd6c800613680d1fe1163f7"}
Jul 23 16:16:26.587169 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:26.587132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:26.587367 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:26.587172    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:26.587367 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:26.587237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:26.587367 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:26.587257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:26.587367 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:26.587312    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:26.587367 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:26.587357    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:26.736148 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:26.736116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hscb4" event={"ID":"6b1c9ac9-9e99-4c0b-9008-349cac0fdef4","Type":"ContainerStarted","Data":"52d14ff53fece63aae39611846671bdb6db6f51195d0498e146a69c1a8f1d414"}
Jul 23 16:16:26.759405 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:26.759358    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hscb4" podStartSLOduration=9.238931847 podStartE2EDuration="39.759341267s" totalImagesPullingTime="30.52040942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:26.757519805 +0000 UTC m=+40.162887061" watchObservedRunningTime="2026-07-23 16:16:26.759341267 +0000 UTC m=+40.164708525"
Jul 23 16:16:28.586583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:28.586546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:28.586583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:28.586577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:28.587095 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:28.586678    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:28.587095 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:28.586733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:28.587095 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:28.586838    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:28.587095 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:28.586932    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:30.586728 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:30.586687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:30.587165 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:30.586735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:30.587165 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:30.586696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:30.587165 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:30.586817    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:30.587165 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:30.586931    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:30.587165 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:30.587015    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:31.974629 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:31.974595    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5chr"]
Jul 23 16:16:31.975073 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:31.974722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:31.975073 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:31.974835    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:31.977978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:31.977949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g9nc"]
Jul 23 16:16:31.978261 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:31.978241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:31.978372 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:31.978342    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:31.978882 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:31.978818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmvfs"]
Jul 23 16:16:31.978967 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:31.978936    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:31.979133 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:31.979104    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:33.586897 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:33.586863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:33.586897 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:33.586896    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:33.587346 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:33.586863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:33.587346 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:33.586985    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:33.587346 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:33.587041    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:33.587346 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:33.587107    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:35.587403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.587361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:35.587790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.587421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:35.587790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.587427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:35.587790 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:35.587513    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmvfs" podUID="f298e161-3b25-4171-8967-f638931ba2fb"
Jul 23 16:16:35.587790 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:35.587602    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g9nc" podUID="270050ed-b65d-42e7-a3bb-d449077efc8f"
Jul 23 16:16:35.587790 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:35.587688    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5chr" podUID="6149737f-227d-43a9-aac4-488a39f01121"
Jul 23 16:16:35.900096 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.900067    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeReady"
Jul 23 16:16:35.900267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.900222    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 16:16:35.952113 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.952084    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r96wn"]
Jul 23 16:16:35.989336 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.989147    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qwxq9"]
Jul 23 16:16:35.989495 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.989266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:35.992252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.992230    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 16:16:35.992559 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.992532    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 16:16:35.992679 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.992649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tj2lp\""
Jul 23 16:16:35.992679 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.992649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 16:16:35.992795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:35.992730    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 16:16:36.002863 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.002830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r96wn"]
Jul 23 16:16:36.002966 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.002890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwxq9"]
Jul 23 16:16:36.002966 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.002908    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-22wx7"]
Jul 23 16:16:36.002966 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.002933    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.005916 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.005893    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pldcw\""
Jul 23 16:16:36.006083 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.006063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 16:16:36.006135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.006109    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 16:16:36.006184 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.006146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 16:16:36.020893 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.020838    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22wx7"]
Jul 23 16:16:36.021039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.020968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.023763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.023745    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 16:16:36.023890 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.023830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khnm5\""
Jul 23 16:16:36.023890 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.023835    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 16:16:36.030118 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05fb1af8-d1fb-4f0d-9415-f374a38014ef-tmp-dir\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.030222 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hq4t\" (UniqueName: \"kubernetes.io/projected/05fb1af8-d1fb-4f0d-9415-f374a38014ef-kube-api-access-6hq4t\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.030222 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05fb1af8-d1fb-4f0d-9415-f374a38014ef-config-volume\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.030222 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-crio-socket\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.030330 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.030330 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15b44d0b-8589-4a22-a5d3-bfba6a90d154-cert\") pod \"ingress-canary-qwxq9\" (UID: \"15b44d0b-8589-4a22-a5d3-bfba6a90d154\") " pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.030411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjf2\" (UniqueName: \"kubernetes.io/projected/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-kube-api-access-5gjf2\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.030411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlpbb\" (UniqueName: \"kubernetes.io/projected/15b44d0b-8589-4a22-a5d3-bfba6a90d154-kube-api-access-tlpbb\") pod \"ingress-canary-qwxq9\" (UID: \"15b44d0b-8589-4a22-a5d3-bfba6a90d154\") " pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.030494 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-data-volume\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.030494 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.030571 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.030530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fb1af8-d1fb-4f0d-9415-f374a38014ef-metrics-tls\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.130988 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.130954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fb1af8-d1fb-4f0d-9415-f374a38014ef-metrics-tls\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05fb1af8-d1fb-4f0d-9415-f374a38014ef-tmp-dir\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hq4t\" (UniqueName: \"kubernetes.io/projected/05fb1af8-d1fb-4f0d-9415-f374a38014ef-kube-api-access-6hq4t\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05fb1af8-d1fb-4f0d-9415-f374a38014ef-config-volume\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-crio-socket\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15b44d0b-8589-4a22-a5d3-bfba6a90d154-cert\") pod \"ingress-canary-qwxq9\" (UID: \"15b44d0b-8589-4a22-a5d3-bfba6a90d154\") " pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.131198 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjf2\" (UniqueName: \"kubernetes.io/projected/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-kube-api-access-5gjf2\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131566 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlpbb\" (UniqueName: \"kubernetes.io/projected/15b44d0b-8589-4a22-a5d3-bfba6a90d154-kube-api-access-tlpbb\") pod \"ingress-canary-qwxq9\" (UID: \"15b44d0b-8589-4a22-a5d3-bfba6a90d154\") " pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.131566 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-data-volume\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131566 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131566 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-crio-socket\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-data-volume\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.131766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05fb1af8-d1fb-4f0d-9415-f374a38014ef-tmp-dir\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.131956 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.131934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.132039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.132016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05fb1af8-d1fb-4f0d-9415-f374a38014ef-config-volume\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.135317 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.135294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.135452 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.135431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fb1af8-d1fb-4f0d-9415-f374a38014ef-metrics-tls\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.135529 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.135516    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15b44d0b-8589-4a22-a5d3-bfba6a90d154-cert\") pod \"ingress-canary-qwxq9\" (UID: \"15b44d0b-8589-4a22-a5d3-bfba6a90d154\") " pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.139310 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.139281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hq4t\" (UniqueName: \"kubernetes.io/projected/05fb1af8-d1fb-4f0d-9415-f374a38014ef-kube-api-access-6hq4t\") pod \"dns-default-22wx7\" (UID: \"05fb1af8-d1fb-4f0d-9415-f374a38014ef\") " pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.139414 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.139368    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjf2\" (UniqueName: \"kubernetes.io/projected/28aabef2-7fd0-4f52-bcdb-d468b5bb4c33-kube-api-access-5gjf2\") pod \"insights-runtime-extractor-r96wn\" (UID: \"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33\") " pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.139725 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.139697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlpbb\" (UniqueName: \"kubernetes.io/projected/15b44d0b-8589-4a22-a5d3-bfba6a90d154-kube-api-access-tlpbb\") pod \"ingress-canary-qwxq9\" (UID: \"15b44d0b-8589-4a22-a5d3-bfba6a90d154\") " pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.300193 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.300109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r96wn"
Jul 23 16:16:36.311145 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.311122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qwxq9"
Jul 23 16:16:36.329509 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.329482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:36.492057 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.491563    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qwxq9"]
Jul 23 16:16:36.495124 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:36.495099    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b44d0b_8589_4a22_a5d3_bfba6a90d154.slice/crio-14b91a338e61f9d3997c147e56848d0e6b07df311ef562288332c1953559ce31 WatchSource:0}: Error finding container 14b91a338e61f9d3997c147e56848d0e6b07df311ef562288332c1953559ce31: Status 404 returned error can't find the container with id 14b91a338e61f9d3997c147e56848d0e6b07df311ef562288332c1953559ce31
Jul 23 16:16:36.502632 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.502607    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r96wn"]
Jul 23 16:16:36.506657 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.506625    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22wx7"]
Jul 23 16:16:36.506978 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:36.506959    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28aabef2_7fd0_4f52_bcdb_d468b5bb4c33.slice/crio-b96e6d9dc8cf732590ba74e6d18559b9932a8aebf818d4557aebe496920947b5 WatchSource:0}: Error finding container b96e6d9dc8cf732590ba74e6d18559b9932a8aebf818d4557aebe496920947b5: Status 404 returned error can't find the container with id b96e6d9dc8cf732590ba74e6d18559b9932a8aebf818d4557aebe496920947b5
Jul 23 16:16:36.510657 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:36.510631    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fb1af8_d1fb_4f0d_9415_f374a38014ef.slice/crio-1cec05e5e7e314db7ed43f4479249e687ae0ab75c766fe713c0014a2cd34941b WatchSource:0}: Error finding container 1cec05e5e7e314db7ed43f4479249e687ae0ab75c766fe713c0014a2cd34941b: Status 404 returned error can't find the container with id 1cec05e5e7e314db7ed43f4479249e687ae0ab75c766fe713c0014a2cd34941b
Jul 23 16:16:36.759903 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.759866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwxq9" event={"ID":"15b44d0b-8589-4a22-a5d3-bfba6a90d154","Type":"ContainerStarted","Data":"14b91a338e61f9d3997c147e56848d0e6b07df311ef562288332c1953559ce31"}
Jul 23 16:16:36.761340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.761309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r96wn" event={"ID":"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33","Type":"ContainerStarted","Data":"b96e6d9dc8cf732590ba74e6d18559b9932a8aebf818d4557aebe496920947b5"}
Jul 23 16:16:36.762294 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:36.762274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22wx7" event={"ID":"05fb1af8-d1fb-4f0d-9415-f374a38014ef","Type":"ContainerStarted","Data":"1cec05e5e7e314db7ed43f4479249e687ae0ab75c766fe713c0014a2cd34941b"}
Jul 23 16:16:37.589266 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.588436    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:37.589266 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.588836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:37.589266 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.589010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:37.593338 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.593311    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4khjt\""
Jul 23 16:16:37.594487 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.593620    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 16:16:37.594487 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.593824    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwhlx\""
Jul 23 16:16:37.594487 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.594026    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 16:16:37.594487 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.594232    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 16:16:37.594487 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:37.594424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 16:16:39.716300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.716083    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"]
Jul 23 16:16:39.730110 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.730068    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"]
Jul 23 16:16:39.730264 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.730224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:39.733214 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.733182    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 16:16:39.733377 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.733217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n95pz\""
Jul 23 16:16:39.760202 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.760152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/715ce523-5644-471c-8652-e38e06ea8064-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcfl9\" (UID: \"715ce523-5644-471c-8652-e38e06ea8064\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:39.773403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.773363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22wx7" event={"ID":"05fb1af8-d1fb-4f0d-9415-f374a38014ef","Type":"ContainerStarted","Data":"2e6ff1dafebe5ca1e368d9cb9fc14afd2757ecfe1081a2bb211aa7d390c0a0a9"}
Jul 23 16:16:39.773599 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.773430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22wx7" event={"ID":"05fb1af8-d1fb-4f0d-9415-f374a38014ef","Type":"ContainerStarted","Data":"b2ef482356998f28ec896e3180617fa9d131a7a282264cc0949efc11f76f9117"}
Jul 23 16:16:39.773599 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.773497    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:39.791242 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.791178    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-22wx7" podStartSLOduration=2.451708092 podStartE2EDuration="4.791153992s" totalImagesPullingTime="2.3394459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:39.790126433 +0000 UTC m=+53.195493691" watchObservedRunningTime="2026-07-23 16:16:39.791153992 +0000 UTC m=+53.196521250"
Jul 23 16:16:39.861475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:39.861364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/715ce523-5644-471c-8652-e38e06ea8064-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcfl9\" (UID: \"715ce523-5644-471c-8652-e38e06ea8064\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:39.861680 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:39.861526    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 16:16:39.861680 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:39.861598    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/715ce523-5644-471c-8652-e38e06ea8064-tls-certificates podName:715ce523-5644-471c-8652-e38e06ea8064 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:40.361576641 +0000 UTC m=+53.766943877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/715ce523-5644-471c-8652-e38e06ea8064-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-jcfl9" (UID: "715ce523-5644-471c-8652-e38e06ea8064") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 23 16:16:40.366266 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:40.366223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/715ce523-5644-471c-8652-e38e06ea8064-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcfl9\" (UID: \"715ce523-5644-471c-8652-e38e06ea8064\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:40.370524 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:40.370495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/715ce523-5644-471c-8652-e38e06ea8064-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jcfl9\" (UID: \"715ce523-5644-471c-8652-e38e06ea8064\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:40.642129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:40.642036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:41.473047 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.473009    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649b97657-n46wk"]
Jul 23 16:16:41.487914 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.487881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.488559 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.488501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649b97657-n46wk"]
Jul 23 16:16:41.491033 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.490863    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 16:16:41.491033 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.490885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 16:16:41.491033 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.490926    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 16:16:41.491033 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.490952    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 16:16:41.491386 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.491364    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sthvq\""
Jul 23 16:16:41.492490 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.492206    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 16:16:41.492490 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.492289    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 16:16:41.492490 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.492310    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 16:16:41.575880 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.575768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-service-ca\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.575880 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.575822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-oauth-serving-cert\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.576077 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.575950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-oauth-config\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.576077 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.576002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8dsj\" (UniqueName: \"kubernetes.io/projected/e1482893-85b9-4321-907f-8582966f8f14-kube-api-access-t8dsj\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.576077 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.576049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-serving-cert\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.576196 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.576083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-console-config\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.677310 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.677260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-service-ca\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.677310 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.677317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-oauth-serving-cert\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.677533 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.677389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-oauth-config\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.677533 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.677437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8dsj\" (UniqueName: \"kubernetes.io/projected/e1482893-85b9-4321-907f-8582966f8f14-kube-api-access-t8dsj\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.677533 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.677468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-serving-cert\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.677533 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.677495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-console-config\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.678298 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.678267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-service-ca\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.678425 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.678279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-oauth-serving-cert\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.678425 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.678328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-console-config\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.680377 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.680350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-oauth-config\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.680477 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.680360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-serving-cert\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.687069 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.687024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8dsj\" (UniqueName: \"kubernetes.io/projected/e1482893-85b9-4321-907f-8582966f8f14-kube-api-access-t8dsj\") pod \"console-649b97657-n46wk\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") " pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:41.799839 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:41.799796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:43.122007 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.121769    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649b97657-n46wk"]
Jul 23 16:16:43.125303 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.125280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"]
Jul 23 16:16:43.127090 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:43.127053    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1482893_85b9_4321_907f_8582966f8f14.slice/crio-f35e8064faa510d895de2a73f547da242cc8f5350b5e4fc32b885a448987f2a6 WatchSource:0}: Error finding container f35e8064faa510d895de2a73f547da242cc8f5350b5e4fc32b885a448987f2a6: Status 404 returned error can't find the container with id f35e8064faa510d895de2a73f547da242cc8f5350b5e4fc32b885a448987f2a6
Jul 23 16:16:43.127807 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:43.127785    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715ce523_5644_471c_8652_e38e06ea8064.slice/crio-176f8849d7a115b4f5adc5ef0d0435a05cc860cc10940b8d8bacb708a4d9f480 WatchSource:0}: Error finding container 176f8849d7a115b4f5adc5ef0d0435a05cc860cc10940b8d8bacb708a4d9f480: Status 404 returned error can't find the container with id 176f8849d7a115b4f5adc5ef0d0435a05cc860cc10940b8d8bacb708a4d9f480
Jul 23 16:16:43.786595 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.786561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qwxq9" event={"ID":"15b44d0b-8589-4a22-a5d3-bfba6a90d154","Type":"ContainerStarted","Data":"c6e08fa5e3af060f9ccbc4debbe04eceda652d8358b5e676cca29c1c4095fd57"}
Jul 23 16:16:43.788166 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.788126    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r96wn" event={"ID":"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33","Type":"ContainerStarted","Data":"fa63d1c1e6cc9dda4bd9bb5b7b8a6bd361c13ffa6faae24aeeb47eec8e5dace8"}
Jul 23 16:16:43.789409 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.789385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649b97657-n46wk" event={"ID":"e1482893-85b9-4321-907f-8582966f8f14","Type":"ContainerStarted","Data":"f35e8064faa510d895de2a73f547da242cc8f5350b5e4fc32b885a448987f2a6"}
Jul 23 16:16:43.790866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.790824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9" event={"ID":"715ce523-5644-471c-8652-e38e06ea8064","Type":"ContainerStarted","Data":"176f8849d7a115b4f5adc5ef0d0435a05cc860cc10940b8d8bacb708a4d9f480"}
Jul 23 16:16:43.811903 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:43.811825    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qwxq9" podStartSLOduration=2.338509064 podStartE2EDuration="8.811801387s" totalImagesPullingTime="6.473292323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:43.811345132 +0000 UTC m=+57.216712401" watchObservedRunningTime="2026-07-23 16:16:43.811801387 +0000 UTC m=+57.217168658"
Jul 23 16:16:45.799784 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:45.799738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9" event={"ID":"715ce523-5644-471c-8652-e38e06ea8064","Type":"ContainerStarted","Data":"79f6d87351e6bbf315bbf132fe0c594c9b9877b307bf1a8c5cd3e49f5b1f9dba"}
Jul 23 16:16:45.800351 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:45.799964    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:45.805244 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:45.805214    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9"
Jul 23 16:16:45.818039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:45.817968    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jcfl9" podStartSLOduration=4.702071333 podStartE2EDuration="6.817949735s" totalImagesPullingTime="2.115878402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:45.816656674 +0000 UTC m=+59.222023932" watchObservedRunningTime="2026-07-23 16:16:45.817949735 +0000 UTC m=+59.223316993"
Jul 23 16:16:46.065196 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.065101    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c47cdcdd8-gmjtq"]
Jul 23 16:16:46.070078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.070052    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.079780 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.079751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c47cdcdd8-gmjtq"]
Jul 23 16:16:46.081092 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.081031    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 16:16:46.112861 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.112812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-trusted-ca-bundle\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.113061 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.112884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-oauth-serving-cert\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.113061 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.112946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-oauth-config\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.116766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.112981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-config\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.116766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.113440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-service-ca\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.116766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.113521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-serving-cert\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.116766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.113561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxrv9\" (UniqueName: \"kubernetes.io/projected/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-kube-api-access-rxrv9\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214283 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxrv9\" (UniqueName: \"kubernetes.io/projected/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-kube-api-access-rxrv9\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214283 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-trusted-ca-bundle\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-oauth-serving-cert\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-oauth-config\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-config\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214662 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-service-ca\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.214662 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.214583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-serving-cert\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.215397 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.215295    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-oauth-serving-cert\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.215397 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.215355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-service-ca\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.215397 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.215389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-config\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.215617 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.215359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-trusted-ca-bundle\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.218353 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.218317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-oauth-config\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.218481 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.218435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-serving-cert\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.222553 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.222528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxrv9\" (UniqueName: \"kubernetes.io/projected/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-kube-api-access-rxrv9\") pod \"console-7c47cdcdd8-gmjtq\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") " pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:46.381439 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:46.381403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:48.695161 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:48.692583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c47cdcdd8-gmjtq"]
Jul 23 16:16:48.713144 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:48.713115    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxpff"
Jul 23 16:16:48.790075 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:48.790040    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14986ed6_1c32_4644_b2e2_2f2c7e7171ac.slice/crio-cb41a61f46b4a5abbad150ef39fc22be20cd13dc7cc82930b25a2726e5fc06c4 WatchSource:0}: Error finding container cb41a61f46b4a5abbad150ef39fc22be20cd13dc7cc82930b25a2726e5fc06c4: Status 404 returned error can't find the container with id cb41a61f46b4a5abbad150ef39fc22be20cd13dc7cc82930b25a2726e5fc06c4
Jul 23 16:16:48.809387 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:48.809354    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649b97657-n46wk" event={"ID":"e1482893-85b9-4321-907f-8582966f8f14","Type":"ContainerStarted","Data":"d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc"}
Jul 23 16:16:48.810610 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:48.810553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c47cdcdd8-gmjtq" event={"ID":"14986ed6-1c32-4644-b2e2-2f2c7e7171ac","Type":"ContainerStarted","Data":"cb41a61f46b4a5abbad150ef39fc22be20cd13dc7cc82930b25a2726e5fc06c4"}
Jul 23 16:16:48.834456 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:48.834406    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649b97657-n46wk" podStartSLOduration=2.4046411069999998 podStartE2EDuration="7.834389715s" totalImagesPullingTime="5.429748608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:48.833914149 +0000 UTC m=+62.239281407" watchObservedRunningTime="2026-07-23 16:16:48.834389715 +0000 UTC m=+62.239756973"
Jul 23 16:16:49.779221 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:49.779185    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-22wx7"
Jul 23 16:16:49.817953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:49.817912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r96wn" event={"ID":"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33","Type":"ContainerStarted","Data":"6c6ea0be9a4c5eb2350e2c9eb01d57997e6aa298946b05340f41069e62ae9de8"}
Jul 23 16:16:49.819858 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:49.819816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c47cdcdd8-gmjtq" event={"ID":"14986ed6-1c32-4644-b2e2-2f2c7e7171ac","Type":"ContainerStarted","Data":"185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a"}
Jul 23 16:16:49.837425 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:49.837362    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c47cdcdd8-gmjtq" podStartSLOduration=3.8373396250000003 podStartE2EDuration="3.837339625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:49.836512941 +0000 UTC m=+63.241880202" watchObservedRunningTime="2026-07-23 16:16:49.837339625 +0000 UTC m=+63.242706882"
Jul 23 16:16:51.801235 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:51.801190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:51.801723 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:51.801266    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:51.806954 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:51.806924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:51.833542 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:51.833513    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:16:52.834578 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:52.834489    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r96wn" event={"ID":"28aabef2-7fd0-4f52-bcdb-d468b5bb4c33","Type":"ContainerStarted","Data":"b929593821042947bd58e8ad4cce153ad02f5a544f85ce1b897a298df65991a7"}
Jul 23 16:16:52.855090 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:52.855035    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r96wn" podStartSLOduration=2.041754647 podStartE2EDuration="17.855017615s" totalImagesPullingTime="15.813262968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:16:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:52.853656569 +0000 UTC m=+66.259023827" watchObservedRunningTime="2026-07-23 16:16:52.855017615 +0000 UTC m=+66.260384897"
Jul 23 16:16:53.071040 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.071001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:53.071214 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.071049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:53.074276 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.074257    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 16:16:53.074596 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.074576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 16:16:53.083978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.083944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f298e161-3b25-4171-8967-f638931ba2fb-metrics-certs\") pod \"network-metrics-daemon-lmvfs\" (UID: \"f298e161-3b25-4171-8967-f638931ba2fb\") " pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:53.083978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.083961    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6149737f-227d-43a9-aac4-488a39f01121-original-pull-secret\") pod \"global-pull-secret-syncer-k5chr\" (UID: \"6149737f-227d-43a9-aac4-488a39f01121\") " pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:53.171741 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.171705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:53.174482 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.174462    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 16:16:53.185540 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.185513    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 16:16:53.195434 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.195404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26924\" (UniqueName: \"kubernetes.io/projected/270050ed-b65d-42e7-a3bb-d449077efc8f-kube-api-access-26924\") pod \"network-check-target-4g9nc\" (UID: \"270050ed-b65d-42e7-a3bb-d449077efc8f\") " pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:53.207362 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.207327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5chr"
Jul 23 16:16:53.219208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.219183    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwhlx\""
Jul 23 16:16:53.226558 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.226530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmvfs"
Jul 23 16:16:53.226687 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.226579    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4khjt\""
Jul 23 16:16:53.234069 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.233993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:53.355955 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.355919    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5chr"]
Jul 23 16:16:53.356588 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:53.356551    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6149737f_227d_43a9_aac4_488a39f01121.slice/crio-811930ba5637d23927fd9e69309fd4fee541f7ed923635989ee6a8ea1a7947d8 WatchSource:0}: Error finding container 811930ba5637d23927fd9e69309fd4fee541f7ed923635989ee6a8ea1a7947d8: Status 404 returned error can't find the container with id 811930ba5637d23927fd9e69309fd4fee541f7ed923635989ee6a8ea1a7947d8
Jul 23 16:16:53.377074 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.377053    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmvfs"]
Jul 23 16:16:53.379122 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:53.379096    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf298e161_3b25_4171_8967_f638931ba2fb.slice/crio-919a1a1d9e2fd8c303d12677fd1e185c986f1b0a2778a3303ea429b755a2b4c1 WatchSource:0}: Error finding container 919a1a1d9e2fd8c303d12677fd1e185c986f1b0a2778a3303ea429b755a2b4c1: Status 404 returned error can't find the container with id 919a1a1d9e2fd8c303d12677fd1e185c986f1b0a2778a3303ea429b755a2b4c1
Jul 23 16:16:53.394183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.394155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g9nc"]
Jul 23 16:16:53.396646 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:53.396618    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270050ed_b65d_42e7_a3bb_d449077efc8f.slice/crio-27ab391d3f2bc340ab191c7bdf95e8ac710787ed5b6cd6bbb2e0705b2c635e9f WatchSource:0}: Error finding container 27ab391d3f2bc340ab191c7bdf95e8ac710787ed5b6cd6bbb2e0705b2c635e9f: Status 404 returned error can't find the container with id 27ab391d3f2bc340ab191c7bdf95e8ac710787ed5b6cd6bbb2e0705b2c635e9f
Jul 23 16:16:53.843014 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.842947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5chr" event={"ID":"6149737f-227d-43a9-aac4-488a39f01121","Type":"ContainerStarted","Data":"811930ba5637d23927fd9e69309fd4fee541f7ed923635989ee6a8ea1a7947d8"}
Jul 23 16:16:53.845135 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.845101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g9nc" event={"ID":"270050ed-b65d-42e7-a3bb-d449077efc8f","Type":"ContainerStarted","Data":"27ab391d3f2bc340ab191c7bdf95e8ac710787ed5b6cd6bbb2e0705b2c635e9f"}
Jul 23 16:16:53.846857 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:53.846816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmvfs" event={"ID":"f298e161-3b25-4171-8967-f638931ba2fb","Type":"ContainerStarted","Data":"919a1a1d9e2fd8c303d12677fd1e185c986f1b0a2778a3303ea429b755a2b4c1"}
Jul 23 16:16:54.123823 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.123017    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"]
Jul 23 16:16:54.125569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.125524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.128821 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.128797    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 16:16:54.129241 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.129216    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 16:16:54.130474 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.130187    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 16:16:54.130474 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.130205    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 16:16:54.130474 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.130421    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sc8kr\""
Jul 23 16:16:54.130696 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.130612    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 16:16:54.141008 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.140953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"]
Jul 23 16:16:54.166044 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.166009    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w7w5x"]
Jul 23 16:16:54.169026 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.168933    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.172347 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.172320    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 16:16:54.172670 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.172642    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 16:16:54.172903 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.172881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 16:16:54.173101 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.173085    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hdrgq\""
Jul 23 16:16:54.174824 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.174804    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"]
Jul 23 16:16:54.179263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.177918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.181255 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.180666    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qprm4\""
Jul 23 16:16:54.181255 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.181004    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 16:16:54.181255 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.181151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.181255 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.181206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.181255 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.181236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.181542 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.181319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64k8w\" (UniqueName: \"kubernetes.io/projected/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-kube-api-access-64k8w\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.183588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.183394    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 16:16:54.183588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.183587    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 16:16:54.194493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.194409    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"]
Jul 23 16:16:54.282329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.282518 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.282518 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-tls\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.282518 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-wtmp\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.282518 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-metrics-client-ca\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9218daeb-5152-4277-8feb-f05b8e889c52-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpkww\" (UniqueName: \"kubernetes.io/projected/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-kube-api-access-qpkww\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-textfile\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.282724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhz5\" (UniqueName: \"kubernetes.io/projected/9218daeb-5152-4277-8feb-f05b8e889c52-kube-api-access-9jhz5\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-sys\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9218daeb-5152-4277-8feb-f05b8e889c52-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64k8w\" (UniqueName: \"kubernetes.io/projected/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-kube-api-access-64k8w\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.283082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.282938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-root\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.283388 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:54.283139    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 23 16:16:54.283388 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:54.283216    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-tls podName:b02463ab-3c74-40ba-9d65-8cdeb9aef86c nodeName:}" failed. No retries permitted until 2026-07-23 16:16:54.78319392 +0000 UTC m=+68.188561162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-9xtx9" (UID: "b02463ab-3c74-40ba-9d65-8cdeb9aef86c") : secret "openshift-state-metrics-tls" not found
Jul 23 16:16:54.283836 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.283791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.285822 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.285799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.293382 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.293332    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64k8w\" (UniqueName: \"kubernetes.io/projected/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-kube-api-access-64k8w\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.383904 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.383798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-root\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.383904 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.383871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.383923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-tls\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.383947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-wtmp\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.383969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-metrics-client-ca\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.383983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-root\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384129 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:54.384077    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 16:16:54.384129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-wtmp\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:54.384165    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-tls podName:8f1e39bd-d1a8-4b07-a428-2529fbe53fc5 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:54.884141414 +0000 UTC m=+68.289508666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-tls") pod "node-exporter-w7w5x" (UID: "8f1e39bd-d1a8-4b07-a428-2529fbe53fc5") : secret "node-exporter-tls" not found
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9218daeb-5152-4277-8feb-f05b8e889c52-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpkww\" (UniqueName: \"kubernetes.io/projected/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-kube-api-access-qpkww\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-textfile\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384371    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhz5\" (UniqueName: \"kubernetes.io/projected/9218daeb-5152-4277-8feb-f05b8e889c52-kube-api-access-9jhz5\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384419 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-sys\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9218daeb-5152-4277-8feb-f05b8e889c52-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-metrics-client-ca\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384735    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-sys\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384867    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9218daeb-5152-4277-8feb-f05b8e889c52-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.384889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.384871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-textfile\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.385231 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:54.384893    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 23 16:16:54.385231 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:16:54.384943    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-tls podName:9218daeb-5152-4277-8feb-f05b8e889c52 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:54.88492539 +0000 UTC m=+68.290292639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-gf9h7" (UID: "9218daeb-5152-4277-8feb-f05b8e889c52") : secret "kube-state-metrics-tls" not found
Jul 23 16:16:54.385335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.385311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9218daeb-5152-4277-8feb-f05b8e889c52-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.385447 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.385402    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.387754 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.387631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.388451 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.388427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.394050 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.393998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpkww\" (UniqueName: \"kubernetes.io/projected/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-kube-api-access-qpkww\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.397630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.395723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhz5\" (UniqueName: \"kubernetes.io/projected/9218daeb-5152-4277-8feb-f05b8e889c52-kube-api-access-9jhz5\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.789407 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.789272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.792340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.792306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b02463ab-3c74-40ba-9d65-8cdeb9aef86c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-9xtx9\" (UID: \"b02463ab-3c74-40ba-9d65-8cdeb9aef86c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:54.853661 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.853622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmvfs" event={"ID":"f298e161-3b25-4171-8967-f638931ba2fb","Type":"ContainerStarted","Data":"dcd31dc49502d57336100665122dff0b4ed4d88a68297007d0374d00d2744fcd"}
Jul 23 16:16:54.854108 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.853691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmvfs" event={"ID":"f298e161-3b25-4171-8967-f638931ba2fb","Type":"ContainerStarted","Data":"a13faae1da8784779844d4e7e7a979a3d7399270375fc569f6d2534a63d8cfbc"}
Jul 23 16:16:54.872106 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.872054    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lmvfs" podStartSLOduration=66.741232729 podStartE2EDuration="1m7.872034532s" totalImagesPullingTime="1.130801803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:54.870624763 +0000 UTC m=+68.275992022" watchObservedRunningTime="2026-07-23 16:16:54.872034532 +0000 UTC m=+68.277401791"
Jul 23 16:16:54.890293 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.890201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-tls\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:54.890293 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.890256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.893593 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.893517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9218daeb-5152-4277-8feb-f05b8e889c52-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gf9h7\" (UID: \"9218daeb-5152-4277-8feb-f05b8e889c52\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:54.893749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:54.893598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f1e39bd-d1a8-4b07-a428-2529fbe53fc5-node-exporter-tls\") pod \"node-exporter-w7w5x\" (UID: \"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5\") " pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:55.042712 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.042673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"
Jul 23 16:16:55.084559 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.084296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7w5x"
Jul 23 16:16:55.093073 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.092861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"
Jul 23 16:16:55.204038 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.203790    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:16:55.218049 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.217998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.219581 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.219555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9"]
Jul 23 16:16:55.221676 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.220994    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.223199    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-49sfx\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.223485    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.223690    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.223945    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.224121    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.224326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 16:16:55.224795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.224478    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:16:55.228332 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.227131    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 16:16:55.228332 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.227251    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 16:16:55.228332 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.227300    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 16:16:55.290259 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.290008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gf9h7"]
Jul 23 16:16:55.292977 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:55.292943    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9218daeb_5152_4277_8feb_f05b8e889c52.slice/crio-a92d182bbeb3b4875fe63ea945886a0e95cef151ed408d0139e6acc3cdbee6a1 WatchSource:0}: Error finding container a92d182bbeb3b4875fe63ea945886a0e95cef151ed408d0139e6acc3cdbee6a1: Status 404 returned error can't find the container with id a92d182bbeb3b4875fe63ea945886a0e95cef151ed408d0139e6acc3cdbee6a1
Jul 23 16:16:55.294776 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.294754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-volume\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.294896 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.294794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-web-config\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.294896 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.294824    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7k6\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-kube-api-access-tx7k6\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.294896 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.294883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-out\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.294916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.294976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295375 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295375 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295375 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.295375 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.295242    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396142 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-volume\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-web-config\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7k6\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-kube-api-access-tx7k6\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-out\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396534 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396534 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396534 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396771 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396771 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396771 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.396982 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.396967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.400559 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.400282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-out\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.401335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.401039    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.401335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.401049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.401937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.401782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-volume\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.402048 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.402022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.402103 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.402075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-web-config\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.403237 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.403215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.403789 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.403756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.405229 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.403961    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.409490 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.409461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-tls-assets\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.409776 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.409759    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.409970 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.409950    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.414029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.414004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7k6\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-kube-api-access-tx7k6\") pod \"alertmanager-main-0\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.535490 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.535451    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:16:55.711763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.711613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:16:55.859894 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.859823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7w5x" event={"ID":"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5","Type":"ContainerStarted","Data":"f47e94d7c354e14f90e191abcdc5fc64981244e2cc7103dad8c5e889e08ecc37"}
Jul 23 16:16:55.862289 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.862161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9" event={"ID":"b02463ab-3c74-40ba-9d65-8cdeb9aef86c","Type":"ContainerStarted","Data":"b52d9c8cf997661b02e900934a25a55f343bf50a05cf704fbd5fb75c337bd3a0"}
Jul 23 16:16:55.862289 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.862226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9" event={"ID":"b02463ab-3c74-40ba-9d65-8cdeb9aef86c","Type":"ContainerStarted","Data":"6e0a358c61ee2115d58beb3f246e9d6f7bc233e63e019d3e4b8a6d59b5e81f70"}
Jul 23 16:16:55.862289 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.862256    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9" event={"ID":"b02463ab-3c74-40ba-9d65-8cdeb9aef86c","Type":"ContainerStarted","Data":"5d493d225c66eb939b72c3b7d23b18b255f05d1fc127e15ea900613b6ae5b358"}
Jul 23 16:16:55.863966 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:55.863936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7" event={"ID":"9218daeb-5152-4277-8feb-f05b8e889c52","Type":"ContainerStarted","Data":"a92d182bbeb3b4875fe63ea945886a0e95cef151ed408d0139e6acc3cdbee6a1"}
Jul 23 16:16:56.382217 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:56.382173    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:56.382401 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:56.382244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:56.387822 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:56.387796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:56.872449 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:56.872414    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:16:56.916046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:56.916008    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649b97657-n46wk"]
Jul 23 16:16:58.263126 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:58.263095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f3b783_5be4_4cac_a49b_ce6a8e049dde.slice/crio-a9c29bb843f703b219879ab584a99da55eaab5e4eb8424f608dcf31111f6bb72 WatchSource:0}: Error finding container a9c29bb843f703b219879ab584a99da55eaab5e4eb8424f608dcf31111f6bb72: Status 404 returned error can't find the container with id a9c29bb843f703b219879ab584a99da55eaab5e4eb8424f608dcf31111f6bb72
Jul 23 16:16:58.520571 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.520501    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59694fc5c-f8768"]
Jul 23 16:16:58.523158 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.523133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.527230 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.527205    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 16:16:58.527401 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.527385    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 16:16:58.527468 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.527403    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lbkj7\""
Jul 23 16:16:58.527540 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.527525    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-es3lm2suhaf7b\""
Jul 23 16:16:58.527607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.527557    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 16:16:58.527985 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.527965    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 16:16:58.533052 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.532992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59694fc5c-f8768"]
Jul 23 16:16:58.639950 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.639900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cdc44ed-50f6-4a88-b007-69d791a80fcb-metrics-server-audit-profiles\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.640112 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.640002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-secret-metrics-server-client-certs\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.640112 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.640087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdc44ed-50f6-4a88-b007-69d791a80fcb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.640207 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.640174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-client-ca-bundle\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.640272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.640213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cdc44ed-50f6-4a88-b007-69d791a80fcb-audit-log\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.640272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.640245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-secret-metrics-server-tls\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.640367 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.640270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggdd\" (UniqueName: \"kubernetes.io/projected/0cdc44ed-50f6-4a88-b007-69d791a80fcb-kube-api-access-hggdd\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-client-ca-bundle\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cdc44ed-50f6-4a88-b007-69d791a80fcb-audit-log\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-secret-metrics-server-tls\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggdd\" (UniqueName: \"kubernetes.io/projected/0cdc44ed-50f6-4a88-b007-69d791a80fcb-kube-api-access-hggdd\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cdc44ed-50f6-4a88-b007-69d791a80fcb-metrics-server-audit-profiles\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-secret-metrics-server-client-certs\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.741816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.741807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdc44ed-50f6-4a88-b007-69d791a80fcb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.742287 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.742044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cdc44ed-50f6-4a88-b007-69d791a80fcb-audit-log\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.742926 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.742898    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cdc44ed-50f6-4a88-b007-69d791a80fcb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.743208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.743184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cdc44ed-50f6-4a88-b007-69d791a80fcb-metrics-server-audit-profiles\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.744912 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.744877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-client-ca-bundle\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.745024 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.744926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-secret-metrics-server-tls\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.745024 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.745003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cdc44ed-50f6-4a88-b007-69d791a80fcb-secret-metrics-server-client-certs\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.750673 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.750650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggdd\" (UniqueName: \"kubernetes.io/projected/0cdc44ed-50f6-4a88-b007-69d791a80fcb-kube-api-access-hggdd\") pod \"metrics-server-59694fc5c-f8768\" (UID: \"0cdc44ed-50f6-4a88-b007-69d791a80fcb\") " pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.835027 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.834998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:16:58.879869 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.879810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g9nc" event={"ID":"270050ed-b65d-42e7-a3bb-d449077efc8f","Type":"ContainerStarted","Data":"6b151cf5f0502e9498a0ac582c50e2ba07845a35ef0f8a01e02655619bb13950"}
Jul 23 16:16:58.880633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.880604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:16:58.886719 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.886391    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7w5x" event={"ID":"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5","Type":"ContainerStarted","Data":"0513751efba131487784ee6aef318658f1b9c3715e295af999a45ed7170e10cc"}
Jul 23 16:16:58.892573 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.892204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9" event={"ID":"b02463ab-3c74-40ba-9d65-8cdeb9aef86c","Type":"ContainerStarted","Data":"3af99e80e2972ebd6614887c82ea688f850968a99f943d5cd945e12a06e7f096"}
Jul 23 16:16:58.895285 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.895067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"a9c29bb843f703b219879ab584a99da55eaab5e4eb8424f608dcf31111f6bb72"}
Jul 23 16:16:58.902228 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.902173    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4g9nc" podStartSLOduration=66.553611982 podStartE2EDuration="1m11.902154154s" totalImagesPullingTime="5.348542172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:58.901392213 +0000 UTC m=+72.306759484" watchObservedRunningTime="2026-07-23 16:16:58.902154154 +0000 UTC m=+72.307521413"
Jul 23 16:16:58.925588 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:58.925506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-9xtx9" podStartSLOduration=1.555121415 podStartE2EDuration="4.925484518s" totalImagesPullingTime="3.370363103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:58.924513855 +0000 UTC m=+72.329881105" watchObservedRunningTime="2026-07-23 16:16:58.925484518 +0000 UTC m=+72.330851777"
Jul 23 16:16:59.028342 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.027959    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59694fc5c-f8768"]
Jul 23 16:16:59.354100 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:59.354044    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdc44ed_50f6_4a88_b007_69d791a80fcb.slice/crio-2b9de6c5cd3f4e2f15c4ac9c4062c006d77db838ec2658430fd1368d50574db3 WatchSource:0}: Error finding container 2b9de6c5cd3f4e2f15c4ac9c4062c006d77db838ec2658430fd1368d50574db3: Status 404 returned error can't find the container with id 2b9de6c5cd3f4e2f15c4ac9c4062c006d77db838ec2658430fd1368d50574db3
Jul 23 16:16:59.467350 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.467316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595bc4b5d7-rf5f5"]
Jul 23 16:16:59.469777 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.469757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.481965 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.481938    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595bc4b5d7-rf5f5"]
Jul 23 16:16:59.551195 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfgd9\" (UniqueName: \"kubernetes.io/projected/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-kube-api-access-zfgd9\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.551195 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-config\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.551195 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-oauth-serving-cert\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.551429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-service-ca\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.551429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-serving-cert\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.551429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-trusted-ca-bundle\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.551429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.551401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-oauth-config\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652291 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-service-ca\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652408 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-serving-cert\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652408 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-trusted-ca-bundle\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652408 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-oauth-config\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652555 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfgd9\" (UniqueName: \"kubernetes.io/projected/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-kube-api-access-zfgd9\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652555 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-config\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.652659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.652578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-oauth-serving-cert\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.653286 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.653263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-service-ca\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.653286 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.653281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-oauth-serving-cert\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.653671 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.653646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-config\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.653922 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.653901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-trusted-ca-bundle\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.655222 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.655197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-oauth-config\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.655442 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.655424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-serving-cert\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.661983 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.661961    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfgd9\" (UniqueName: \"kubernetes.io/projected/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-kube-api-access-zfgd9\") pod \"console-595bc4b5d7-rf5f5\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") " pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.780501 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.780435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:16:59.902126 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.901997    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f1e39bd-d1a8-4b07-a428-2529fbe53fc5" containerID="0513751efba131487784ee6aef318658f1b9c3715e295af999a45ed7170e10cc" exitCode=0
Jul 23 16:16:59.902288 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.902139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7w5x" event={"ID":"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5","Type":"ContainerDied","Data":"0513751efba131487784ee6aef318658f1b9c3715e295af999a45ed7170e10cc"}
Jul 23 16:16:59.904132 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.904074    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928" exitCode=0
Jul 23 16:16:59.904249 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.904170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"}
Jul 23 16:16:59.906973 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.906920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5chr" event={"ID":"6149737f-227d-43a9-aac4-488a39f01121","Type":"ContainerStarted","Data":"bfa5a240fd0bbe2166343159caa8a0b10848d65dba0ffaeb0670ac98944bf2bf"}
Jul 23 16:16:59.908504 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.908451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59694fc5c-f8768" event={"ID":"0cdc44ed-50f6-4a88-b007-69d791a80fcb","Type":"ContainerStarted","Data":"2b9de6c5cd3f4e2f15c4ac9c4062c006d77db838ec2658430fd1368d50574db3"}
Jul 23 16:16:59.915416 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.914287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7" event={"ID":"9218daeb-5152-4277-8feb-f05b8e889c52","Type":"ContainerStarted","Data":"7e5a84ad8ba834ecf2254770cee3e72d1f5746ce5b5bdd6957ac0d522b1ae7fc"}
Jul 23 16:16:59.915416 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.914329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7" event={"ID":"9218daeb-5152-4277-8feb-f05b8e889c52","Type":"ContainerStarted","Data":"4ba02ecd11a21cab4de3ad2734c4edddf4ed0965131cce33dd8241c955509442"}
Jul 23 16:16:59.915416 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.914374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7" event={"ID":"9218daeb-5152-4277-8feb-f05b8e889c52","Type":"ContainerStarted","Data":"47d41803793a853e54aaef56cb07ac9a8e37ec27182c30d1f7148b9db0e86a60"}
Jul 23 16:16:59.936039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.936016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595bc4b5d7-rf5f5"]
Jul 23 16:16:59.939028 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:16:59.938962    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda07ff00_7ad8_4a6d_92a8_8b5a8d7165cd.slice/crio-820a7c652938530c6dba476b9ea04a5b29fe41de954f36c01358ae93a743e858 WatchSource:0}: Error finding container 820a7c652938530c6dba476b9ea04a5b29fe41de954f36c01358ae93a743e858: Status 404 returned error can't find the container with id 820a7c652938530c6dba476b9ea04a5b29fe41de954f36c01358ae93a743e858
Jul 23 16:16:59.967181 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.966951    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5chr" podStartSLOduration=67.545219487 podStartE2EDuration="1m12.96692661s" totalImagesPullingTime="5.421707123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:59.966582416 +0000 UTC m=+73.371949672" watchObservedRunningTime="2026-07-23 16:16:59.96692661 +0000 UTC m=+73.372293858"
Jul 23 16:16:59.988380 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:16:59.988325    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-gf9h7" podStartSLOduration=1.658544266 podStartE2EDuration="5.988301132s" totalImagesPullingTime="4.329756866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:59.987759492 +0000 UTC m=+73.393126754" watchObservedRunningTime="2026-07-23 16:16:59.988301132 +0000 UTC m=+73.393668392"
Jul 23 16:17:00.313810 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.313765    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:17:00.316943 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.316919    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.319675 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.319649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ae4fnk3ah0bud\""
Jul 23 16:17:00.320293 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320023    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 16:17:00.320293 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320040    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 16:17:00.320293 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320075    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 16:17:00.320293 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320227    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6jw4\""
Jul 23 16:17:00.320560 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320332    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 16:17:00.320560 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320354    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 16:17:00.320560 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320473    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 16:17:00.320891 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320764    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 16:17:00.320891 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320839    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 16:17:00.321118 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320867    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 16:17:00.321118 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.320972    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 16:17:00.321272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.321241    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 16:17:00.321350 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.321308    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 16:17:00.325103 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.325082    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 16:17:00.328057 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.328037    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 16:17:00.335358 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.335332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:17:00.462289 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-config-out\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.462763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcn9l\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-kube-api-access-lcn9l\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-config\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.462979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-web-config\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.463138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.463007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.563943 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.563834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.563943 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.563902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.563943 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.563932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.563957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.563982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcn9l\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-kube-api-access-lcn9l\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-config\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-web-config\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-config-out\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564902 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.564902 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.564758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.565222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.565297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.565839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.567581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.568152    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.568628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.569309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569834 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.569396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-config-out\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.569834 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.569817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.570569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.570545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-web-config\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.570734 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.570708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.571053 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.571030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.571053 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.571043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.571235 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.571193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.571669 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.571628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.571756 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.571714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-config\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.572944 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.572926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.578013 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.577990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcn9l\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-kube-api-access-lcn9l\") pod \"prometheus-k8s-0\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.629267 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.629227    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:00.922719 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.922662    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7w5x" event={"ID":"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5","Type":"ContainerStarted","Data":"dd57f2768c87118fbbf7a4ff24a0d2f10211e4c5a51d44e5a9e28851ed55d958"}
Jul 23 16:17:00.922905 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.922766    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7w5x" event={"ID":"8f1e39bd-d1a8-4b07-a428-2529fbe53fc5","Type":"ContainerStarted","Data":"a304aa1b84774d49bc74bd771fb99b7be6d3178b2294868b8e23ab882c30b83d"}
Jul 23 16:17:00.924964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.924931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59694fc5c-f8768" event={"ID":"0cdc44ed-50f6-4a88-b007-69d791a80fcb","Type":"ContainerStarted","Data":"9f6c66df512888b3a509a91a346a4705293b7d1a4c16c083f55544aca10b3f44"}
Jul 23 16:17:00.926736 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.926703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595bc4b5d7-rf5f5" event={"ID":"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd","Type":"ContainerStarted","Data":"e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7"}
Jul 23 16:17:00.926873 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.926754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595bc4b5d7-rf5f5" event={"ID":"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd","Type":"ContainerStarted","Data":"820a7c652938530c6dba476b9ea04a5b29fe41de954f36c01358ae93a743e858"}
Jul 23 16:17:00.941974 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.941927    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w7w5x" podStartSLOduration=3.188770856 podStartE2EDuration="6.941909464s" totalImagesPullingTime="3.636673976s" totalInitContainerRuntime="116.464632ms" isStatefulPod=true podCreationTimestamp="2026-07-23 16:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:00.941347806 +0000 UTC m=+74.346715079" watchObservedRunningTime="2026-07-23 16:17:00.941909464 +0000 UTC m=+74.347276722"
Jul 23 16:17:00.961887 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.961673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:17:00.963029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.962991    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595bc4b5d7-rf5f5" podStartSLOduration=1.9629763150000001 podStartE2EDuration="1.962976315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:00.962073048 +0000 UTC m=+74.367440320" watchObservedRunningTime="2026-07-23 16:17:00.962976315 +0000 UTC m=+74.368343573"
Jul 23 16:17:00.965188 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:17:00.965164    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d05109_ad90_4aa8_ba46_628da6f9412e.slice/crio-4f7faacfbef5034d0c7ca9c2549c9870e4668909d9cd8a23768c06cfa5439d30 WatchSource:0}: Error finding container 4f7faacfbef5034d0c7ca9c2549c9870e4668909d9cd8a23768c06cfa5439d30: Status 404 returned error can't find the container with id 4f7faacfbef5034d0c7ca9c2549c9870e4668909d9cd8a23768c06cfa5439d30
Jul 23 16:17:00.985692 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:00.985597    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59694fc5c-f8768" podStartSLOduration=1.494990192 podStartE2EDuration="2.985573531s" totalImagesPullingTime="1.490583339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:00.984926386 +0000 UTC m=+74.390293644" watchObservedRunningTime="2026-07-23 16:17:00.985573531 +0000 UTC m=+74.390940791"
Jul 23 16:17:01.932412 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:01.932374    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d" exitCode=0
Jul 23 16:17:01.932796 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:01.932478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"}
Jul 23 16:17:01.932796 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:01.932561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"4f7faacfbef5034d0c7ca9c2549c9870e4668909d9cd8a23768c06cfa5439d30"}
Jul 23 16:17:02.939978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:02.939893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"}
Jul 23 16:17:02.940314 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:02.939994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"}
Jul 23 16:17:02.940314 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:02.940022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"}
Jul 23 16:17:02.940314 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:02.940047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"}
Jul 23 16:17:02.940314 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:02.940070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"}
Jul 23 16:17:03.948695 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:03.948650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerStarted","Data":"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"}
Jul 23 16:17:03.976705 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:03.976642    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.448616088 podStartE2EDuration="8.976621832s" totalImagesPullingTime="4.507811669s" totalInitContainerRuntime="20.194075ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:03.973497332 +0000 UTC m=+77.378864592" watchObservedRunningTime="2026-07-23 16:17:03.976621832 +0000 UTC m=+77.381989090"
Jul 23 16:17:05.960864 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:05.960820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"}
Jul 23 16:17:05.961219 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:05.960907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"}
Jul 23 16:17:07.973253 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:07.973171    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"}
Jul 23 16:17:07.973253 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:07.973234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"}
Jul 23 16:17:07.973650 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:07.973259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"}
Jul 23 16:17:07.973650 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:07.973284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerStarted","Data":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"}
Jul 23 16:17:08.017160 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:08.017101    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.42449871 podStartE2EDuration="8.017082424s" totalImagesPullingTime="5.567704731s" totalInitContainerRuntime="24.878983ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:17:08.014375821 +0000 UTC m=+81.419743103" watchObservedRunningTime="2026-07-23 16:17:08.017082424 +0000 UTC m=+81.422449681"
Jul 23 16:17:09.781262 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:09.781130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:17:09.781262 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:09.781205    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:17:09.786007 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:09.785979    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:17:09.984703 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:09.984679    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:17:10.048579 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:10.048496    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c47cdcdd8-gmjtq"]
Jul 23 16:17:10.630312 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:10.630280    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:17:18.835291 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:18.835245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:17:18.835877 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:18.835312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:17:21.944987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:21.944916    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-649b97657-n46wk" podUID="e1482893-85b9-4321-907f-8582966f8f14" containerName="console" containerID="cri-o://d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc" gracePeriod=15
Jul 23 16:17:22.738320 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.738288    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:17:22.770213 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770184    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8dsj\" (UniqueName: \"kubernetes.io/projected/e1482893-85b9-4321-907f-8582966f8f14-kube-api-access-t8dsj\") pod \"e1482893-85b9-4321-907f-8582966f8f14\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") "
Jul 23 16:17:22.770389 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770228    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-oauth-serving-cert\") pod \"e1482893-85b9-4321-907f-8582966f8f14\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") "
Jul 23 16:17:22.770389 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770280    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-service-ca\") pod \"e1482893-85b9-4321-907f-8582966f8f14\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") "
Jul 23 16:17:22.770389 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770312    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-serving-cert\") pod \"e1482893-85b9-4321-907f-8582966f8f14\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") "
Jul 23 16:17:22.770389 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770336    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-console-config\") pod \"e1482893-85b9-4321-907f-8582966f8f14\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") "
Jul 23 16:17:22.770592 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-oauth-config\") pod \"e1482893-85b9-4321-907f-8582966f8f14\" (UID: \"e1482893-85b9-4321-907f-8582966f8f14\") "
Jul 23 16:17:22.770649 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770614    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1482893-85b9-4321-907f-8582966f8f14" (UID: "e1482893-85b9-4321-907f-8582966f8f14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:22.770705 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770638    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1482893-85b9-4321-907f-8582966f8f14" (UID: "e1482893-85b9-4321-907f-8582966f8f14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:22.770993 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.770953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-console-config" (OuterVolumeSpecName: "console-config") pod "e1482893-85b9-4321-907f-8582966f8f14" (UID: "e1482893-85b9-4321-907f-8582966f8f14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:22.772691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.772657    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1482893-85b9-4321-907f-8582966f8f14" (UID: "e1482893-85b9-4321-907f-8582966f8f14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:17:22.772797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.772713    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1482893-85b9-4321-907f-8582966f8f14-kube-api-access-t8dsj" (OuterVolumeSpecName: "kube-api-access-t8dsj") pod "e1482893-85b9-4321-907f-8582966f8f14" (UID: "e1482893-85b9-4321-907f-8582966f8f14"). InnerVolumeSpecName "kube-api-access-t8dsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:17:22.772797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.772718    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1482893-85b9-4321-907f-8582966f8f14" (UID: "e1482893-85b9-4321-907f-8582966f8f14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:17:22.872006 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.871979    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-oauth-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:22.872006 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.872007    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8dsj\" (UniqueName: \"kubernetes.io/projected/e1482893-85b9-4321-907f-8582966f8f14-kube-api-access-t8dsj\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:22.872189 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.872016    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-oauth-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:22.872189 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.872026    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-service-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:22.872189 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.872034    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1482893-85b9-4321-907f-8582966f8f14-console-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:22.872189 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:22.872044    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1482893-85b9-4321-907f-8582966f8f14-console-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.034868 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.034816    2582 generic.go:356] "Generic (PLEG): container finished" podID="e1482893-85b9-4321-907f-8582966f8f14" containerID="d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc" exitCode=0
Jul 23 16:17:23.035290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.034879    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649b97657-n46wk"
Jul 23 16:17:23.035290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.034896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649b97657-n46wk" event={"ID":"e1482893-85b9-4321-907f-8582966f8f14","Type":"ContainerDied","Data":"d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc"}
Jul 23 16:17:23.035290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.034957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649b97657-n46wk" event={"ID":"e1482893-85b9-4321-907f-8582966f8f14","Type":"ContainerDied","Data":"f35e8064faa510d895de2a73f547da242cc8f5350b5e4fc32b885a448987f2a6"}
Jul 23 16:17:23.035290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.034979    2582 scope.go:117] "RemoveContainer" containerID="d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc"
Jul 23 16:17:23.048491 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.048473    2582 scope.go:117] "RemoveContainer" containerID="d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc"
Jul 23 16:17:23.048806 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:17:23.048781    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc\": container with ID starting with d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc not found: ID does not exist" containerID="d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc"
Jul 23 16:17:23.048920 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.048811    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc"} err="failed to get container status \"d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc\": rpc error: code = NotFound desc = could not find container \"d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc\": container with ID starting with d422b65030de33db24636888bb022a45186bd44dc8cac2ef52dd54e76aa4f4cc not found: ID does not exist"
Jul 23 16:17:23.058423 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.058397    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649b97657-n46wk"]
Jul 23 16:17:23.060764 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.060729    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-649b97657-n46wk"]
Jul 23 16:17:23.592049 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:23.592019    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1482893-85b9-4321-907f-8582966f8f14" path="/var/lib/kubelet/pods/e1482893-85b9-4321-907f-8582966f8f14/volumes"
Jul 23 16:17:30.930342 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:30.930308    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4g9nc"
Jul 23 16:17:35.068295 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.068245    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c47cdcdd8-gmjtq" podUID="14986ed6-1c32-4644-b2e2-2f2c7e7171ac" containerName="console" containerID="cri-o://185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a" gracePeriod=15
Jul 23 16:17:35.352350 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.352319    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:17:35.485218 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485181    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-service-ca\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485388 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485231    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-config\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485388 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485272    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-serving-cert\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485388 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485321    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-oauth-config\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485388 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxrv9\" (UniqueName: \"kubernetes.io/projected/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-kube-api-access-rxrv9\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485388 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485379    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-trusted-ca-bundle\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485631 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485412    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-oauth-serving-cert\") pod \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\" (UID: \"14986ed6-1c32-4644-b2e2-2f2c7e7171ac\") "
Jul 23 16:17:35.485690 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485621    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-service-ca" (OuterVolumeSpecName: "service-ca") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:35.485746 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485698    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-config" (OuterVolumeSpecName: "console-config") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:35.485799 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485788    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:35.485900 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485808    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-service-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:35.485900 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485812    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:35.485900 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.485878    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:35.487784 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.487748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:17:35.487784 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.487762    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-kube-api-access-rxrv9" (OuterVolumeSpecName: "kube-api-access-rxrv9") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "kube-api-access-rxrv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:17:35.487978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.487802    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14986ed6-1c32-4644-b2e2-2f2c7e7171ac" (UID: "14986ed6-1c32-4644-b2e2-2f2c7e7171ac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:17:35.586526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.586438    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:35.586526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.586466    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-console-oauth-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:35.586526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.586475    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxrv9\" (UniqueName: \"kubernetes.io/projected/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-kube-api-access-rxrv9\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:35.586526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.586487    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:35.586526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:35.586497    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14986ed6-1c32-4644-b2e2-2f2c7e7171ac-oauth-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:17:36.093273 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.093237    2582 generic.go:356] "Generic (PLEG): container finished" podID="14986ed6-1c32-4644-b2e2-2f2c7e7171ac" containerID="185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a" exitCode=0
Jul 23 16:17:36.093711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.093284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c47cdcdd8-gmjtq" event={"ID":"14986ed6-1c32-4644-b2e2-2f2c7e7171ac","Type":"ContainerDied","Data":"185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a"}
Jul 23 16:17:36.093711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.093298    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c47cdcdd8-gmjtq"
Jul 23 16:17:36.093711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.093328    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c47cdcdd8-gmjtq" event={"ID":"14986ed6-1c32-4644-b2e2-2f2c7e7171ac","Type":"ContainerDied","Data":"cb41a61f46b4a5abbad150ef39fc22be20cd13dc7cc82930b25a2726e5fc06c4"}
Jul 23 16:17:36.093711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.093348    2582 scope.go:117] "RemoveContainer" containerID="185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a"
Jul 23 16:17:36.101506 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.101470    2582 scope.go:117] "RemoveContainer" containerID="185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a"
Jul 23 16:17:36.101758 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:17:36.101735    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a\": container with ID starting with 185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a not found: ID does not exist" containerID="185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a"
Jul 23 16:17:36.101822 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.101771    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a"} err="failed to get container status \"185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a\": rpc error: code = NotFound desc = could not find container \"185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a\": container with ID starting with 185a05b1f6b9daf31c09790f510220bba75e70b825bbea85a769cc9ab6cd5a5a not found: ID does not exist"
Jul 23 16:17:36.111299 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.111276    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c47cdcdd8-gmjtq"]
Jul 23 16:17:36.113396 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:36.113376    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c47cdcdd8-gmjtq"]
Jul 23 16:17:37.592749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:37.592717    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14986ed6-1c32-4644-b2e2-2f2c7e7171ac" path="/var/lib/kubelet/pods/14986ed6-1c32-4644-b2e2-2f2c7e7171ac/volumes"
Jul 23 16:17:38.840958 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:38.840931    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:17:38.844754 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:17:38.844731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59694fc5c-f8768"
Jul 23 16:18:00.629562 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:00.629510    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:00.650406 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:00.650378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:01.202571 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:01.202545    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:14.378584 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.378546    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:18:14.379017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.378878    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="alertmanager" containerID="cri-o://916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7" gracePeriod=120
Jul 23 16:18:14.379017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.378947    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-metric" containerID="cri-o://822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e" gracePeriod=120
Jul 23 16:18:14.379017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.378964    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-web" containerID="cri-o://ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a" gracePeriod=120
Jul 23 16:18:14.379017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.378963    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy" containerID="cri-o://7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8" gracePeriod=120
Jul 23 16:18:14.379300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.378997    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="config-reloader" containerID="cri-o://ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874" gracePeriod=120
Jul 23 16:18:14.379300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:14.379105    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="prom-label-proxy" containerID="cri-o://0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d" gracePeriod=120
Jul 23 16:18:15.245270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245238    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d" exitCode=0
Jul 23 16:18:15.245270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245262    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8" exitCode=0
Jul 23 16:18:15.245270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245270    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874" exitCode=0
Jul 23 16:18:15.245270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245275    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7" exitCode=0
Jul 23 16:18:15.245539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"}
Jul 23 16:18:15.245539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"}
Jul 23 16:18:15.245539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245401    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"}
Jul 23 16:18:15.245539 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.245427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"}
Jul 23 16:18:15.642558 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.642529    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:15.726009 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.725976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-trusted-ca-bundle\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726009 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-tls-assets\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-main-tls\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726077    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-web-config\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-out\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-web\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-metrics-client-ca\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726208    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-cluster-tls-config\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726236    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-volume\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726263 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726257    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-main-db\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726637 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726292    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-metric\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726637 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726637 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726366    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx7k6\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-kube-api-access-tx7k6\") pod \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\" (UID: \"88f3b783-5be4-4cac-a49b-ce6a8e049dde\") "
Jul 23 16:18:15.726637 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726525    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:15.726637 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726580    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:15.726929 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726678    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.726929 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726698    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88f3b783-5be4-4cac-a49b-ce6a8e049dde-metrics-client-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.726929 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.726905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:18:15.729656 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.729625    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.729795 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.729700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-out" (OuterVolumeSpecName: "config-out") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:18:15.730142 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.730109    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:18:15.730375 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.730351    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-kube-api-access-tx7k6" (OuterVolumeSpecName: "kube-api-access-tx7k6") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "kube-api-access-tx7k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:18:15.730473 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.730451    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.730616 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.730594    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.730692 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.730672    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-volume" (OuterVolumeSpecName: "config-volume") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.730789 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.730756    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.733458 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.733435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.740064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.740038    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-web-config" (OuterVolumeSpecName: "web-config") pod "88f3b783-5be4-4cac-a49b-ce6a8e049dde" (UID: "88f3b783-5be4-4cac-a49b-ce6a8e049dde"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827040    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-web-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827076    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-out\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827086    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827095    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-cluster-tls-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827103    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-config-volume\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827112    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/88f3b783-5be4-4cac-a49b-ce6a8e049dde-alertmanager-main-db\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827120    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827129    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827137    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx7k6\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-kube-api-access-tx7k6\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827139 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827146    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88f3b783-5be4-4cac-a49b-ce6a8e049dde-tls-assets\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:15.827536 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:15.827154    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/88f3b783-5be4-4cac-a49b-ce6a8e049dde-secret-alertmanager-main-tls\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:16.252550 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252517    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e" exitCode=0
Jul 23 16:18:16.252550 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252544    2582 generic.go:356] "Generic (PLEG): container finished" podID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerID="ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a" exitCode=0
Jul 23 16:18:16.252755 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"}
Jul 23 16:18:16.252755 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252624    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.252755 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"}
Jul 23 16:18:16.252755 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252731    2582 scope.go:117] "RemoveContainer" containerID="0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"
Jul 23 16:18:16.252920 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.252755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"88f3b783-5be4-4cac-a49b-ce6a8e049dde","Type":"ContainerDied","Data":"a9c29bb843f703b219879ab584a99da55eaab5e4eb8424f608dcf31111f6bb72"}
Jul 23 16:18:16.260930 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.260910    2582 scope.go:117] "RemoveContainer" containerID="822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"
Jul 23 16:18:16.267883 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.267857    2582 scope.go:117] "RemoveContainer" containerID="7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"
Jul 23 16:18:16.274516 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.274498    2582 scope.go:117] "RemoveContainer" containerID="ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"
Jul 23 16:18:16.276306 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.276284    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:18:16.281232 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.281207    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:18:16.282766 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.282743    2582 scope.go:117] "RemoveContainer" containerID="ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"
Jul 23 16:18:16.289387 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.289370    2582 scope.go:117] "RemoveContainer" containerID="916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"
Jul 23 16:18:16.296159 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.296142    2582 scope.go:117] "RemoveContainer" containerID="44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"
Jul 23 16:18:16.303107 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303086    2582 scope.go:117] "RemoveContainer" containerID="0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"
Jul 23 16:18:16.303356 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.303335    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d\": container with ID starting with 0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d not found: ID does not exist" containerID="0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"
Jul 23 16:18:16.303428 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303371    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"} err="failed to get container status \"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d\": rpc error: code = NotFound desc = could not find container \"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d\": container with ID starting with 0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d not found: ID does not exist"
Jul 23 16:18:16.303428 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303398    2582 scope.go:117] "RemoveContainer" containerID="822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"
Jul 23 16:18:16.303635 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.303620    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e\": container with ID starting with 822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e not found: ID does not exist" containerID="822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"
Jul 23 16:18:16.303699 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303642    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"} err="failed to get container status \"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e\": rpc error: code = NotFound desc = could not find container \"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e\": container with ID starting with 822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e not found: ID does not exist"
Jul 23 16:18:16.303699 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303662    2582 scope.go:117] "RemoveContainer" containerID="7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"
Jul 23 16:18:16.303914 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.303898    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8\": container with ID starting with 7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8 not found: ID does not exist" containerID="7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"
Jul 23 16:18:16.303973 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303920    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"} err="failed to get container status \"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8\": rpc error: code = NotFound desc = could not find container \"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8\": container with ID starting with 7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8 not found: ID does not exist"
Jul 23 16:18:16.303973 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.303938    2582 scope.go:117] "RemoveContainer" containerID="ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"
Jul 23 16:18:16.304148 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.304132    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a\": container with ID starting with ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a not found: ID does not exist" containerID="ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"
Jul 23 16:18:16.304207 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304152    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"} err="failed to get container status \"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a\": rpc error: code = NotFound desc = could not find container \"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a\": container with ID starting with ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a not found: ID does not exist"
Jul 23 16:18:16.304207 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304169    2582 scope.go:117] "RemoveContainer" containerID="ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"
Jul 23 16:18:16.304394 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.304379    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874\": container with ID starting with ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874 not found: ID does not exist" containerID="ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"
Jul 23 16:18:16.304455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304401    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"} err="failed to get container status \"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874\": rpc error: code = NotFound desc = could not find container \"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874\": container with ID starting with ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874 not found: ID does not exist"
Jul 23 16:18:16.304455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304419    2582 scope.go:117] "RemoveContainer" containerID="916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"
Jul 23 16:18:16.304669 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.304652    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7\": container with ID starting with 916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7 not found: ID does not exist" containerID="916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"
Jul 23 16:18:16.304724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304676    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"} err="failed to get container status \"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7\": rpc error: code = NotFound desc = could not find container \"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7\": container with ID starting with 916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7 not found: ID does not exist"
Jul 23 16:18:16.304724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304695    2582 scope.go:117] "RemoveContainer" containerID="44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"
Jul 23 16:18:16.304957 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:16.304939    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928\": container with ID starting with 44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928 not found: ID does not exist" containerID="44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"
Jul 23 16:18:16.305048 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304959    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"} err="failed to get container status \"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928\": rpc error: code = NotFound desc = could not find container \"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928\": container with ID starting with 44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928 not found: ID does not exist"
Jul 23 16:18:16.305048 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.304972    2582 scope.go:117] "RemoveContainer" containerID="0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"
Jul 23 16:18:16.305190 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305175    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d"} err="failed to get container status \"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d\": rpc error: code = NotFound desc = could not find container \"0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d\": container with ID starting with 0c7cfde96d27b09d7ba24e708ff23e241154ca613acbc29a4be0f8050419960d not found: ID does not exist"
Jul 23 16:18:16.305230 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305190    2582 scope.go:117] "RemoveContainer" containerID="822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"
Jul 23 16:18:16.305403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305382    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e"} err="failed to get container status \"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e\": rpc error: code = NotFound desc = could not find container \"822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e\": container with ID starting with 822872286e489a6ba0b3c90e43069f0fcdd629fe1d81906d40db3b8e3786446e not found: ID does not exist"
Jul 23 16:18:16.305475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305406    2582 scope.go:117] "RemoveContainer" containerID="7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"
Jul 23 16:18:16.305616 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305599    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8"} err="failed to get container status \"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8\": rpc error: code = NotFound desc = could not find container \"7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8\": container with ID starting with 7c2756f10dc24bb55d6878a2e02725856f70e7ac880eeb95244b84d4c5eaa5f8 not found: ID does not exist"
Jul 23 16:18:16.305683 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305617    2582 scope.go:117] "RemoveContainer" containerID="ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"
Jul 23 16:18:16.305835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305811    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a"} err="failed to get container status \"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a\": rpc error: code = NotFound desc = could not find container \"ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a\": container with ID starting with ce31ff415e0c4bd1d6821cffa27cf70e3f87b9db60f7251ab9086fcf47231f0a not found: ID does not exist"
Jul 23 16:18:16.305835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.305834    2582 scope.go:117] "RemoveContainer" containerID="ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"
Jul 23 16:18:16.306216 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.306111    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874"} err="failed to get container status \"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874\": rpc error: code = NotFound desc = could not find container \"ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874\": container with ID starting with ef6e778bc87b4700c73a41d61a890a45d65f006bfa10df1e809ec151ed353874 not found: ID does not exist"
Jul 23 16:18:16.306216 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.306139    2582 scope.go:117] "RemoveContainer" containerID="916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"
Jul 23 16:18:16.307140 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.306655    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7"} err="failed to get container status \"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7\": rpc error: code = NotFound desc = could not find container \"916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7\": container with ID starting with 916fc1c58e182f498f223e7deb0a66c6b0f14b13ac67f4cce74ec456927aa9b7 not found: ID does not exist"
Jul 23 16:18:16.307140 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.306681    2582 scope.go:117] "RemoveContainer" containerID="44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"
Jul 23 16:18:16.307300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.307138    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928"} err="failed to get container status \"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928\": rpc error: code = NotFound desc = could not find container \"44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928\": container with ID starting with 44773930fe8549d7a90b1316d0792411364b19fbfabadf8ea70eab3f1a687928 not found: ID does not exist"
Jul 23 16:18:16.308526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308505    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:18:16.308779 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308767    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-metric"
Jul 23 16:18:16.308779 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308780    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-metric"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308788    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1482893-85b9-4321-907f-8582966f8f14" containerName="console"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308802    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1482893-85b9-4321-907f-8582966f8f14" containerName="console"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308814    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="prom-label-proxy"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308820    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="prom-label-proxy"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308826    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="config-reloader"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308831    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="config-reloader"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308837    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14986ed6-1c32-4644-b2e2-2f2c7e7171ac" containerName="console"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308856    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="14986ed6-1c32-4644-b2e2-2f2c7e7171ac" containerName="console"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308866    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="init-config-reloader"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308872    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="init-config-reloader"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308880    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308886    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308896    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="alertmanager"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308901    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="alertmanager"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308907    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-web"
Jul 23 16:18:16.308913 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308911    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-web"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308956    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="14986ed6-1c32-4644-b2e2-2f2c7e7171ac" containerName="console"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308963    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="config-reloader"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308968    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="alertmanager"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1482893-85b9-4321-907f-8582966f8f14" containerName="console"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308980    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-metric"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="prom-label-proxy"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308990    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy-web"
Jul 23 16:18:16.309455 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.308996    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" containerName="kube-rbac-proxy"
Jul 23 16:18:16.312429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.312414    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.315270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 16:18:16.315387 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 16:18:16.315387 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315305    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 16:18:16.315525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315501    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 16:18:16.315525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315512    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-49sfx\""
Jul 23 16:18:16.315633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315585    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 16:18:16.315683 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 16:18:16.315927 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315908    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 16:18:16.315927 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.315920    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 16:18:16.321195 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.321175    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 16:18:16.327325 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.327303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:18:16.330882 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.330835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.330981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.330892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-web-config\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.330981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.330930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.330981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.330956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d796v\" (UniqueName: \"kubernetes.io/projected/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-kube-api-access-d796v\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331149 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-config-out\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331149 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331149 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331498 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.331498 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.331336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432237 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432237 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432453 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432453 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432453 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432601 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432601 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-web-config\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432809 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432809 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d796v\" (UniqueName: \"kubernetes.io/projected/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-kube-api-access-d796v\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432809 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432994 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-config-out\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.432994 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.432885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.433159 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.433133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.433516 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.433491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.435442 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.435408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.435533 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.435484    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.435602 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.435547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.435602 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.435566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.435700 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.435621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.435898 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.435881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.436064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.436048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.436190 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.436168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-web-config\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.437225 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.437205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-config-out\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.441230 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.441209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d796v\" (UniqueName: \"kubernetes.io/projected/2f27ecfc-8166-4f2b-9608-fc7ddaee83b8-kube-api-access-d796v\") pod \"alertmanager-main-0\" (UID: \"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.622213 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.622182    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 16:18:16.751538 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:16.751503    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 16:18:16.754507 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:18:16.754480    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f27ecfc_8166_4f2b_9608_fc7ddaee83b8.slice/crio-0dd8f544347a02be45d4d23ec8d1799f8c19d28776694cfa2fea5c29d31871c3 WatchSource:0}: Error finding container 0dd8f544347a02be45d4d23ec8d1799f8c19d28776694cfa2fea5c29d31871c3: Status 404 returned error can't find the container with id 0dd8f544347a02be45d4d23ec8d1799f8c19d28776694cfa2fea5c29d31871c3
Jul 23 16:18:17.258310 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:17.258279    2582 generic.go:356] "Generic (PLEG): container finished" podID="2f27ecfc-8166-4f2b-9608-fc7ddaee83b8" containerID="bd737cfc965ee606e75680d57f1776dca3bc8f914221f7c5c562d5ebb4398b9b" exitCode=0
Jul 23 16:18:17.258501 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:17.258376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerDied","Data":"bd737cfc965ee606e75680d57f1776dca3bc8f914221f7c5c562d5ebb4398b9b"}
Jul 23 16:18:17.258501 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:17.258463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"0dd8f544347a02be45d4d23ec8d1799f8c19d28776694cfa2fea5c29d31871c3"}
Jul 23 16:18:17.593568 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:17.593539    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f3b783-5be4-4cac-a49b-ce6a8e049dde" path="/var/lib/kubelet/pods/88f3b783-5be4-4cac-a49b-ce6a8e049dde/volumes"
Jul 23 16:18:18.267059 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.267026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"3cca69249d685bf932b6ae202877c3cbf150ca850931a57e68711548086262fe"}
Jul 23 16:18:18.267448 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.267089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"150a1bf38287ae94b0d12cd00505d9f8e7b710fde82f24a7154fcfd7dec945fc"}
Jul 23 16:18:18.267448 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.267118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"33d80f33109db9a7b6748db9c091253e3a3cd97c3f8c6efd8f543048dce9663c"}
Jul 23 16:18:18.267448 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.267143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"107ffd0315d6ba55be2ce17a7a10921407e4cd8860d4c3ef913504d4719b9604"}
Jul 23 16:18:18.267448 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.267166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"3f592c6fbfaf52be92f55496cff77d7567df47d27ac15b7d8d6bf52474478f1b"}
Jul 23 16:18:18.267448 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.267187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2f27ecfc-8166-4f2b-9608-fc7ddaee83b8","Type":"ContainerStarted","Data":"20a8247ed6cd9e8f4f3367bd40485f79aa65e46e10f5346d27a3740b5bf5ed7c"}
Jul 23 16:18:18.305216 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.305150    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.287756045 podStartE2EDuration="2.305128214s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.372169ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:18:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:18:18.303138253 +0000 UTC m=+151.708505523" watchObservedRunningTime="2026-07-23 16:18:18.305128214 +0000 UTC m=+151.710495473"
Jul 23 16:18:18.703399 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703363    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:18:18.703686 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703655    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="prometheus" containerID="cri-o://a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc" gracePeriod=600
Jul 23 16:18:18.703686 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703669    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="thanos-sidecar" containerID="cri-o://da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498" gracePeriod=600
Jul 23 16:18:18.703884 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703687    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="config-reloader" containerID="cri-o://32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4" gracePeriod=600
Jul 23 16:18:18.703884 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703729    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341" gracePeriod=600
Jul 23 16:18:18.703884 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703694    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-web" containerID="cri-o://f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262" gracePeriod=600
Jul 23 16:18:18.703884 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.703814    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy" containerID="cri-o://04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe" gracePeriod=600
Jul 23 16:18:18.938964 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:18.938938    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.055247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055152    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-db\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-trusted-ca-bundle\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-metrics-client-ca\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-1\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-tls\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055307    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-thanos-prometheus-http-client-file\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-config-out\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-kube-rbac-proxy\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055604    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.055714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055625    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcn9l\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-kube-api-access-lcn9l\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055668    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055696    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-kubelet-serving-ca-bundle\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.055714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055694    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-serving-certs-ca-bundle\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055774    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-grpc-tls\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055811    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055842    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-0\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055904    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-web-config\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.055965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-2\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-tls-assets\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056029    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-config\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-metrics-client-certs\") pod \"38d05109-ad90-4aa8-ba46-628da6f9412e\" (UID: \"38d05109-ad90-4aa8-ba46-628da6f9412e\") "
Jul 23 16:18:19.056411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056212    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.056411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056299    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.056411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056314    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-metrics-client-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.056411 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056327    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.056674 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.056647    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.057103 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.057073    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.057683 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.057655    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.057777 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.057761    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:18:19.058197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.058156    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:19.058604 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.058564    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-kube-api-access-lcn9l" (OuterVolumeSpecName: "kube-api-access-lcn9l") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "kube-api-access-lcn9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:18:19.058787 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.058761    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.059057 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.059013    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.059145 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.059124    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.059230 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.059209    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-config-out" (OuterVolumeSpecName: "config-out") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:18:19.059335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.059308    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.059957 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.059932    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-config" (OuterVolumeSpecName: "config") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.060060 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.059954    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.060218 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.060199    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.060717 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.060696    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:18:19.060841 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.060824    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.069707 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.069680    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-web-config" (OuterVolumeSpecName: "web-config") pod "38d05109-ad90-4aa8-ba46-628da6f9412e" (UID: "38d05109-ad90-4aa8-ba46-628da6f9412e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:19.157181 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157141    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcn9l\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-kube-api-access-lcn9l\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157181 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157173    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157181 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157184    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157194    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-grpc-tls\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157203    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157214    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157223    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-web-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157231    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157241    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38d05109-ad90-4aa8-ba46-628da6f9412e-tls-assets\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157249    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157256    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-metrics-client-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157264    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-db\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157272    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38d05109-ad90-4aa8-ba46-628da6f9412e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157280    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157288    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157296    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38d05109-ad90-4aa8-ba46-628da6f9412e-config-out\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.157390 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.157304    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38d05109-ad90-4aa8-ba46-628da6f9412e-secret-kube-rbac-proxy\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:19.274126 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274094    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341" exitCode=0
Jul 23 16:18:19.274126 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274122    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe" exitCode=0
Jul 23 16:18:19.274126 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274128    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262" exitCode=0
Jul 23 16:18:19.274126 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274134    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498" exitCode=0
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274139    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4" exitCode=0
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274145    2582 generic.go:356] "Generic (PLEG): container finished" podID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc" exitCode=0
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274170    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"}
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"}
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"}
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"}
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"}
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274351    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"}
Jul 23 16:18:19.274570 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.274390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38d05109-ad90-4aa8-ba46-628da6f9412e","Type":"ContainerDied","Data":"4f7faacfbef5034d0c7ca9c2549c9870e4668909d9cd8a23768c06cfa5439d30"}
Jul 23 16:18:19.285670 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.285650    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.292861 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.292821    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.299660 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.299640    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.302501 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.302481    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:18:19.307972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.307870    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:18:19.308022 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.307980    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.314515 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.314494    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.321590 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.321570    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.328364 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.328348    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.328604 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.328584    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.328668 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.328617    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"} err="failed to get container status \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist"
Jul 23 16:18:19.328668 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.328645    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.328935 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.328919    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.328972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.328944    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"} err="failed to get container status \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist"
Jul 23 16:18:19.328972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.328960    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.329186 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.329166    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.329232 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329192    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"} err="failed to get container status \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist"
Jul 23 16:18:19.329232 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329207    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.329425 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.329408    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.329480 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329431    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"} err="failed to get container status \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist"
Jul 23 16:18:19.329480 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329449    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.329661 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.329647    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.329704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329664    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"} err="failed to get container status \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist"
Jul 23 16:18:19.329704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329676    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.329886 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.329867    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.329929 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329891    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"} err="failed to get container status \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist"
Jul 23 16:18:19.329929 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.329904    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.330110 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:19.330097    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.330147 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330112    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"} err="failed to get container status \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist"
Jul 23 16:18:19.330147 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330122    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.330308 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330294    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"} err="failed to get container status \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist"
Jul 23 16:18:19.330353 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330308    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.330479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330464    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"} err="failed to get container status \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist"
Jul 23 16:18:19.330514 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330479    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.330667 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330650    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"} err="failed to get container status \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist"
Jul 23 16:18:19.330708 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330667    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.330909 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330889    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"} err="failed to get container status \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist"
Jul 23 16:18:19.330979 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.330910    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.331128 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331109    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"} err="failed to get container status \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist"
Jul 23 16:18:19.331175 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331128    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.331346 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331320    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"} err="failed to get container status \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist"
Jul 23 16:18:19.331346 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331337    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.331542 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331526    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"} err="failed to get container status \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist"
Jul 23 16:18:19.331542 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331541    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.331714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331699    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"} err="failed to get container status \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist"
Jul 23 16:18:19.331714 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331713    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.331931 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331914    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"} err="failed to get container status \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist"
Jul 23 16:18:19.331987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.331931    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.332142 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332123    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"} err="failed to get container status \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist"
Jul 23 16:18:19.332202 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332142    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.332309 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332295    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"} err="failed to get container status \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist"
Jul 23 16:18:19.332354 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332309    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.332457 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332443    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"} err="failed to get container status \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist"
Jul 23 16:18:19.332492 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332457    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.332609 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332595    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"} err="failed to get container status \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist"
Jul 23 16:18:19.332657 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332608    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.332804 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332783    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"} err="failed to get container status \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist"
Jul 23 16:18:19.332868 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332804    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.333013 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.332998    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"} err="failed to get container status \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist"
Jul 23 16:18:19.333051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333014    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.333208 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333193    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"} err="failed to get container status \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist"
Jul 23 16:18:19.333248 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333208    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.333427 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333404    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"} err="failed to get container status \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist"
Jul 23 16:18:19.333475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333430    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.333647 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333631    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"} err="failed to get container status \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist"
Jul 23 16:18:19.333717 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333648    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.333942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333915    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"} err="failed to get container status \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist"
Jul 23 16:18:19.333942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.333941    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.334209 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.334187    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"} err="failed to get container status \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist"
Jul 23 16:18:19.334209 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.334210    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.334525 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.334503    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"} err="failed to get container status \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist"
Jul 23 16:18:19.334659 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.334527    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.334909 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.334886    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"} err="failed to get container status \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist"
Jul 23 16:18:19.334979 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.334911    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.335329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.335306    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"} err="failed to get container status \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist"
Jul 23 16:18:19.335329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.335329    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.335600 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.335579    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"} err="failed to get container status \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist"
Jul 23 16:18:19.335672 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.335601    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.335859 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.335824    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"} err="failed to get container status \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist"
Jul 23 16:18:19.335907 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.335859    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.336108 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336086    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"} err="failed to get container status \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist"
Jul 23 16:18:19.336108 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336106    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.336340 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336325    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"} err="failed to get container status \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist"
Jul 23 16:18:19.336381 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336339    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.336381 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336365    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:18:19.336549 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336531    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"} err="failed to get container status \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist"
Jul 23 16:18:19.336589 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336554    2582 scope.go:117] "RemoveContainer" containerID="7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"
Jul 23 16:18:19.336688 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336674    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-thanos"
Jul 23 16:18:19.336742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336689    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-thanos"
Jul 23 16:18:19.336742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336703    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="thanos-sidecar"
Jul 23 16:18:19.336742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336712    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="thanos-sidecar"
Jul 23 16:18:19.336742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336723    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy"
Jul 23 16:18:19.336742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336731    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy"
Jul 23 16:18:19.336742 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336742    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="config-reloader"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336749    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="config-reloader"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336760    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="prometheus"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336766    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="prometheus"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336754    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341"} err="failed to get container status \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": rpc error: code = NotFound desc = could not find container \"7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341\": container with ID starting with 7d18ce2a5927045c30d7a4daa26b893a89bff3a69b2be2f8b23db9914aab9341 not found: ID does not exist"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336783    2582 scope.go:117] "RemoveContainer" containerID="04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336771    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="init-config-reloader"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336839    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="init-config-reloader"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336874    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-web"
Jul 23 16:18:19.336953 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336882    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-web"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336963    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="prometheus"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336980    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="config-reloader"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="thanos-sidecar"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.336994    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-thanos"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337003    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" containerName="kube-rbac-proxy-web"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337050    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe"} err="failed to get container status \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": rpc error: code = NotFound desc = could not find container \"04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe\": container with ID starting with 04350ff0bc67d7eb41e141fdba623d03a7f4fd05d3603f971f4113b0b0cbebfe not found: ID does not exist"
Jul 23 16:18:19.337252 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337069    2582 scope.go:117] "RemoveContainer" containerID="f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"
Jul 23 16:18:19.337530 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337308    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262"} err="failed to get container status \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": rpc error: code = NotFound desc = could not find container \"f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262\": container with ID starting with f8bcde48fb057a1e7cb88986a3e6053f72037e88ef73eed74e3c9c35c3000262 not found: ID does not exist"
Jul 23 16:18:19.337530 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337321    2582 scope.go:117] "RemoveContainer" containerID="da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"
Jul 23 16:18:19.337594 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337538    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498"} err="failed to get container status \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": rpc error: code = NotFound desc = could not find container \"da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498\": container with ID starting with da510e0b3b0dd2f72ec2aadcd48aab855743ccf50bcd0e74a5c9df6ba6e3f498 not found: ID does not exist"
Jul 23 16:18:19.337594 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337561    2582 scope.go:117] "RemoveContainer" containerID="32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"
Jul 23 16:18:19.337822 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337804    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4"} err="failed to get container status \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": rpc error: code = NotFound desc = could not find container \"32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4\": container with ID starting with 32952f2c84a714d5b2b00678dbeaf819e93a40812c0c489a9e5d70aaa1b7dff4 not found: ID does not exist"
Jul 23 16:18:19.337880 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.337831    2582 scope.go:117] "RemoveContainer" containerID="a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"
Jul 23 16:18:19.338083 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.338062    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc"} err="failed to get container status \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": rpc error: code = NotFound desc = could not find container \"a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc\": container with ID starting with a76011a4513782a03d40955fccaa272fa74804a2562ce1928c6714763f1295cc not found: ID does not exist"
Jul 23 16:18:19.338128 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.338085    2582 scope.go:117] "RemoveContainer" containerID="40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"
Jul 23 16:18:19.338300 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.338285    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d"} err="failed to get container status \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": rpc error: code = NotFound desc = could not find container \"40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d\": container with ID starting with 40f8be283ef8e0b58a5e7bde6fef9022f8dd0b3fedcf05fa4672f64f8d69605d not found: ID does not exist"
Jul 23 16:18:19.341017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.341004    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.344012 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.343990    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 16:18:19.344134 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344030    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 16:18:19.344319 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344273    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 16:18:19.344391 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344342    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 16:18:19.344466 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344442    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 16:18:19.344556 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344543    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 16:18:19.344613 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344579    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 16:18:19.344816 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344790    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ae4fnk3ah0bud\""
Jul 23 16:18:19.344922 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344835    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 16:18:19.344922 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344897    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6jw4\""
Jul 23 16:18:19.345039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.344962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 16:18:19.345194 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.345168    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 16:18:19.345451 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.345435    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 16:18:19.345503 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.345478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 16:18:19.348483 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.348465    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 16:18:19.350441 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.350424    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 16:18:19.358665 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.358646    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:18:19.460598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-config\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca5ff64-eb78-40fa-ad1e-16238024bafc-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca5ff64-eb78-40fa-ad1e-16238024bafc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.460942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.460983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmzg\" (UniqueName: \"kubernetes.io/projected/0ca5ff64-eb78-40fa-ad1e-16238024bafc-kube-api-access-gtmzg\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.461003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.461022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.461075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.461110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.461290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.461137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562396 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-config\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562489 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562529 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562579 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562579 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca5ff64-eb78-40fa-ad1e-16238024bafc-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562674 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562674 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562674 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562819 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562819 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562819 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562819 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca5ff64-eb78-40fa-ad1e-16238024bafc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.562819 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.563087 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.563087 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmzg\" (UniqueName: \"kubernetes.io/projected/0ca5ff64-eb78-40fa-ad1e-16238024bafc-kube-api-access-gtmzg\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.563087 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.563087 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.563331 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.563210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.563834 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.563805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565277 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565389 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565442 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.562901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565507 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-config\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565558 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565632 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-web-config\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.565687 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565613    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.566475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.565830    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.566475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.566143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.566475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.566174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.566475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.566270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca5ff64-eb78-40fa-ad1e-16238024bafc-config-out\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.566917 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.566894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.567059 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.567035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.567772 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.567748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.567882 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.567814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0ca5ff64-eb78-40fa-ad1e-16238024bafc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.568030 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.568013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca5ff64-eb78-40fa-ad1e-16238024bafc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.568818 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.568788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0ca5ff64-eb78-40fa-ad1e-16238024bafc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.574029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.574010    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmzg\" (UniqueName: \"kubernetes.io/projected/0ca5ff64-eb78-40fa-ad1e-16238024bafc-kube-api-access-gtmzg\") pod \"prometheus-k8s-0\" (UID: \"0ca5ff64-eb78-40fa-ad1e-16238024bafc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.592060 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.592035    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d05109-ad90-4aa8-ba46-628da6f9412e" path="/var/lib/kubelet/pods/38d05109-ad90-4aa8-ba46-628da6f9412e/volumes"
Jul 23 16:18:19.650833 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.650803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:19.784808 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:19.784770    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 16:18:19.787633 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:18:19.787607    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca5ff64_eb78_40fa_ad1e_16238024bafc.slice/crio-335c047d103923c27c8c6640184e24616c55fb44e0d2d122052f0bd6b57fdb56 WatchSource:0}: Error finding container 335c047d103923c27c8c6640184e24616c55fb44e0d2d122052f0bd6b57fdb56: Status 404 returned error can't find the container with id 335c047d103923c27c8c6640184e24616c55fb44e0d2d122052f0bd6b57fdb56
Jul 23 16:18:20.282511 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:20.282478    2582 generic.go:356] "Generic (PLEG): container finished" podID="0ca5ff64-eb78-40fa-ad1e-16238024bafc" containerID="2d5fc78bb6d3565eadcab0ac1be79a1bd60f2671377bc4cb56018c4897d73c91" exitCode=0
Jul 23 16:18:20.282511 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:20.282516    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerDied","Data":"2d5fc78bb6d3565eadcab0ac1be79a1bd60f2671377bc4cb56018c4897d73c91"}
Jul 23 16:18:20.283041 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:20.282567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"335c047d103923c27c8c6640184e24616c55fb44e0d2d122052f0bd6b57fdb56"}
Jul 23 16:18:21.289512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.289478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"50b55f3220df1c48992eeab794dc9d504a2f8f0307cc85ba60d385e16371dce2"}
Jul 23 16:18:21.289983 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.289567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"625023423d4379017a473075f9b0a7900a45e920ff31cad8eae7c4a582031a88"}
Jul 23 16:18:21.289983 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.289596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"e95e2bc5138e06a44bfad637f985b24875203d9e17201d481ebe1a027277189a"}
Jul 23 16:18:21.289983 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.289619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"f9aea1e457dcb872b5c7dd4e7d1205ab30374e64599ed41d7bb90fd562c6b023"}
Jul 23 16:18:21.289983 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.289646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"64f7ce4a078a9f70b676a12f1e7c2cb24da79da7183232ec12119f9202d024dc"}
Jul 23 16:18:21.289983 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.289674    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0ca5ff64-eb78-40fa-ad1e-16238024bafc","Type":"ContainerStarted","Data":"70561d37b492a2afd7cd264806e7921f107c9cea2909bfc825fee4677685f393"}
Jul 23 16:18:21.321182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:21.321130    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.30214753 podStartE2EDuration="2.321113836s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.966306ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:18:21.320118073 +0000 UTC m=+154.725485335" watchObservedRunningTime="2026-07-23 16:18:21.321113836 +0000 UTC m=+154.726481094"
Jul 23 16:18:22.773679 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.773644    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-754b7466b4-xxsn9"]
Jul 23 16:18:22.776070 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.776053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.791948 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.791918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754b7466b4-xxsn9"]
Jul 23 16:18:22.893749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-oauth-config\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.893749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqc6s\" (UniqueName: \"kubernetes.io/projected/f83af881-efcc-4677-867f-58735db7c53b-kube-api-access-fqc6s\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.893962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-service-ca\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.893962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-serving-cert\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.893962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-console-config\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.893962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-trusted-ca-bundle\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.893962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.893935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-oauth-serving-cert\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.994670 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-trusted-ca-bundle\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.994670 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-oauth-serving-cert\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.994933 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-oauth-config\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.994933 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqc6s\" (UniqueName: \"kubernetes.io/projected/f83af881-efcc-4677-867f-58735db7c53b-kube-api-access-fqc6s\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.994933 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-service-ca\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.994933 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-serving-cert\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.995125 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.994998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-console-config\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.995607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.995583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-trusted-ca-bundle\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.995607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.995594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-oauth-serving-cert\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.995783 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.995604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-service-ca\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.995783 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.995703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-console-config\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.997289 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.997266    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-oauth-config\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:22.997524 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:22.997507    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-serving-cert\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:23.004425 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:23.004405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqc6s\" (UniqueName: \"kubernetes.io/projected/f83af881-efcc-4677-867f-58735db7c53b-kube-api-access-fqc6s\") pod \"console-754b7466b4-xxsn9\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") " pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:23.085558 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:23.085464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:23.221223 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:23.221195    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754b7466b4-xxsn9"]
Jul 23 16:18:23.223397 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:18:23.223367    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83af881_efcc_4677_867f_58735db7c53b.slice/crio-5de6931eeff955d6a484466c9ade711c77f84baa5696ae9ff8f9596514c66bf5 WatchSource:0}: Error finding container 5de6931eeff955d6a484466c9ade711c77f84baa5696ae9ff8f9596514c66bf5: Status 404 returned error can't find the container with id 5de6931eeff955d6a484466c9ade711c77f84baa5696ae9ff8f9596514c66bf5
Jul 23 16:18:23.299704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:23.299670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b7466b4-xxsn9" event={"ID":"f83af881-efcc-4677-867f-58735db7c53b","Type":"ContainerStarted","Data":"b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf"}
Jul 23 16:18:23.299880 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:23.299717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b7466b4-xxsn9" event={"ID":"f83af881-efcc-4677-867f-58735db7c53b","Type":"ContainerStarted","Data":"5de6931eeff955d6a484466c9ade711c77f84baa5696ae9ff8f9596514c66bf5"}
Jul 23 16:18:23.319085 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:23.319027    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-754b7466b4-xxsn9" podStartSLOduration=1.319005968 podStartE2EDuration="1.319005968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:18:23.31888695 +0000 UTC m=+156.724254207" watchObservedRunningTime="2026-07-23 16:18:23.319005968 +0000 UTC m=+156.724373270"
Jul 23 16:18:24.651296 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:24.651238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:18:33.086314 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:33.086273    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:33.086768 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:33.086342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:33.091136 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:33.091117    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:33.344043 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:33.343956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:18:33.390112 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:33.390076    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595bc4b5d7-rf5f5"]
Jul 23 16:18:58.411536 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.411461    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-595bc4b5d7-rf5f5" podUID="da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" containerName="console" containerID="cri-o://e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7" gracePeriod=15
Jul 23 16:18:58.663349 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.663289    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:18:58.700620 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700594    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-oauth-serving-cert\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.700797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfgd9\" (UniqueName: \"kubernetes.io/projected/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-kube-api-access-zfgd9\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.700797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700668    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-config\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.700941 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700833    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-service-ca\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.700941 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700901    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-oauth-config\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.701047 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-serving-cert\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.701047 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.700982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-trusted-ca-bundle\") pod \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\" (UID: \"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd\") "
Jul 23 16:18:58.701148 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701086    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:58.701201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701140    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-config" (OuterVolumeSpecName: "console-config") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:58.701201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701192    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-service-ca" (OuterVolumeSpecName: "service-ca") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:58.701395 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701366    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-oauth-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:58.701395 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701399    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:58.701575 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701414    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-service-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:58.701575 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.701450    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:18:58.702968 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.702943    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-kube-api-access-zfgd9" (OuterVolumeSpecName: "kube-api-access-zfgd9") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "kube-api-access-zfgd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:18:58.703064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.703007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:58.703110 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.703097    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" (UID: "da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:18:58.801954 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.801912    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfgd9\" (UniqueName: \"kubernetes.io/projected/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-kube-api-access-zfgd9\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:58.801954 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.801945    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-oauth-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:58.801954 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.801954    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-console-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:58.801954 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:58.801964    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:18:59.440738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.440705    2582 generic.go:356] "Generic (PLEG): container finished" podID="da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" containerID="e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7" exitCode=0
Jul 23 16:18:59.441170 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.440745    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595bc4b5d7-rf5f5"
Jul 23 16:18:59.441170 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.440765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595bc4b5d7-rf5f5" event={"ID":"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd","Type":"ContainerDied","Data":"e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7"}
Jul 23 16:18:59.441170 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.440832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595bc4b5d7-rf5f5" event={"ID":"da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd","Type":"ContainerDied","Data":"820a7c652938530c6dba476b9ea04a5b29fe41de954f36c01358ae93a743e858"}
Jul 23 16:18:59.441170 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.440869    2582 scope.go:117] "RemoveContainer" containerID="e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7"
Jul 23 16:18:59.449426 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.449407    2582 scope.go:117] "RemoveContainer" containerID="e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7"
Jul 23 16:18:59.449690 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:18:59.449673    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7\": container with ID starting with e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7 not found: ID does not exist" containerID="e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7"
Jul 23 16:18:59.449735 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.449700    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7"} err="failed to get container status \"e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7\": rpc error: code = NotFound desc = could not find container \"e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7\": container with ID starting with e7ed89e1ac1f6fdc45608dd9aa19752076e0d576d8a579b6ef91b37fc1fcaae7 not found: ID does not exist"
Jul 23 16:18:59.462266 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.462238    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595bc4b5d7-rf5f5"]
Jul 23 16:18:59.464076 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.464055    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-595bc4b5d7-rf5f5"]
Jul 23 16:18:59.591752 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:18:59.591719    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" path="/var/lib/kubelet/pods/da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd/volumes"
Jul 23 16:19:19.651177 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:19.651140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:19:19.666394 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:19.666366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:19:20.540290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:20.540262    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 16:19:32.831710 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:32.831679    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ffb4777d6-rf6vb"]
Jul 23 16:19:32.832270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:32.832054    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" containerName="console"
Jul 23 16:19:32.832270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:32.832068    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" containerName="console"
Jul 23 16:19:32.832270 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:32.832132    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da07ff00-7ad8-4a6d-92a8-8b5a8d7165cd" containerName="console"
Jul 23 16:19:32.834607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:32.834589    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:32.844254 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:32.844227    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffb4777d6-rf6vb"]
Jul 23 16:19:33.008840 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.008798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-console-config\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.009051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.008897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-oauth-config\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.009051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.008921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-trusted-ca-bundle\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.009051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.008937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-serving-cert\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.009051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.008953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62mg\" (UniqueName: \"kubernetes.io/projected/19d6ad4d-aef9-453a-a640-711f450282a2-kube-api-access-s62mg\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.009051 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.009022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-oauth-serving-cert\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.009212 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.009055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-service-ca\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110477 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-service-ca\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110477 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-console-config\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110710 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-oauth-config\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110710 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-trusted-ca-bundle\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110710 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-serving-cert\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110710 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62mg\" (UniqueName: \"kubernetes.io/projected/19d6ad4d-aef9-453a-a640-711f450282a2-kube-api-access-s62mg\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.110710 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.110607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-oauth-serving-cert\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.111607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.111563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-console-config\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.111767 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.111740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-trusted-ca-bundle\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.111831 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.111699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-oauth-serving-cert\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.111831 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.111594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-service-ca\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.117253 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.117219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-oauth-config\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.117408 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.117385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-serving-cert\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.120043 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.120020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62mg\" (UniqueName: \"kubernetes.io/projected/19d6ad4d-aef9-453a-a640-711f450282a2-kube-api-access-s62mg\") pod \"console-6ffb4777d6-rf6vb\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") " pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.144149 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.144092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:33.330878 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.330825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffb4777d6-rf6vb"]
Jul 23 16:19:33.334019 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:19:33.333990    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d6ad4d_aef9_453a_a640_711f450282a2.slice/crio-9785bc2a12d3327a312388364686589a898a5191756ee84db34fa0cd66789c6f WatchSource:0}: Error finding container 9785bc2a12d3327a312388364686589a898a5191756ee84db34fa0cd66789c6f: Status 404 returned error can't find the container with id 9785bc2a12d3327a312388364686589a898a5191756ee84db34fa0cd66789c6f
Jul 23 16:19:33.575181 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.575144    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb4777d6-rf6vb" event={"ID":"19d6ad4d-aef9-453a-a640-711f450282a2","Type":"ContainerStarted","Data":"7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe"}
Jul 23 16:19:33.575394 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.575199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb4777d6-rf6vb" event={"ID":"19d6ad4d-aef9-453a-a640-711f450282a2","Type":"ContainerStarted","Data":"9785bc2a12d3327a312388364686589a898a5191756ee84db34fa0cd66789c6f"}
Jul 23 16:19:33.593369 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:33.593312    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ffb4777d6-rf6vb" podStartSLOduration=1.593293219 podStartE2EDuration="1.593293219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:19:33.592390631 +0000 UTC m=+226.997757892" watchObservedRunningTime="2026-07-23 16:19:33.593293219 +0000 UTC m=+226.998660477"
Jul 23 16:19:43.145112 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:43.145072    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:43.145567 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:43.145137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:43.150058 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:43.150034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:43.615654 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:43.615625    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:19:43.658840 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:19:43.658805    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754b7466b4-xxsn9"]
Jul 23 16:20:08.680093 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:08.679986    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-754b7466b4-xxsn9" podUID="f83af881-efcc-4677-867f-58735db7c53b" containerName="console" containerID="cri-o://b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf" gracePeriod=15
Jul 23 16:20:08.920896 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:08.920874    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:20:09.022017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.021929    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqc6s\" (UniqueName: \"kubernetes.io/projected/f83af881-efcc-4677-867f-58735db7c53b-kube-api-access-fqc6s\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.021983    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-service-ca\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022006    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-console-config\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022298 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022025    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-serving-cert\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022298 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022073    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-oauth-serving-cert\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022298 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022099    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-trusted-ca-bundle\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022298 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022260    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-oauth-config\") pod \"f83af881-efcc-4677-867f-58735db7c53b\" (UID: \"f83af881-efcc-4677-867f-58735db7c53b\") "
Jul 23 16:20:09.022517 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022494    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-service-ca" (OuterVolumeSpecName: "service-ca") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:20:09.022633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022568    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-console-config" (OuterVolumeSpecName: "console-config") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:20:09.022633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022592    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-service-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.022633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022608    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:20:09.022800 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.022651    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:20:09.024239 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.024210    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:20:09.024239 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.024229    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:20:09.024364 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.024275    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f83af881-efcc-4677-867f-58735db7c53b-kube-api-access-fqc6s" (OuterVolumeSpecName: "kube-api-access-fqc6s") pod "f83af881-efcc-4677-867f-58735db7c53b" (UID: "f83af881-efcc-4677-867f-58735db7c53b"). InnerVolumeSpecName "kube-api-access-fqc6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:20:09.124039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.123998    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-oauth-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.124039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.124032    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqc6s\" (UniqueName: \"kubernetes.io/projected/f83af881-efcc-4677-867f-58735db7c53b-kube-api-access-fqc6s\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.124039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.124047    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-console-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.124260 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.124059    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f83af881-efcc-4677-867f-58735db7c53b-console-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.124260 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.124072    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-oauth-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.124260 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.124083    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83af881-efcc-4677-867f-58735db7c53b-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:20:09.716721 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.716683    2582 generic.go:356] "Generic (PLEG): container finished" podID="f83af881-efcc-4677-867f-58735db7c53b" containerID="b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf" exitCode=0
Jul 23 16:20:09.717197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.716745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b7466b4-xxsn9" event={"ID":"f83af881-efcc-4677-867f-58735db7c53b","Type":"ContainerDied","Data":"b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf"}
Jul 23 16:20:09.717197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.716791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b7466b4-xxsn9" event={"ID":"f83af881-efcc-4677-867f-58735db7c53b","Type":"ContainerDied","Data":"5de6931eeff955d6a484466c9ade711c77f84baa5696ae9ff8f9596514c66bf5"}
Jul 23 16:20:09.717197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.716820    2582 scope.go:117] "RemoveContainer" containerID="b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf"
Jul 23 16:20:09.717197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.716749    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b7466b4-xxsn9"
Jul 23 16:20:09.724931 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.724914    2582 scope.go:117] "RemoveContainer" containerID="b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf"
Jul 23 16:20:09.725196 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:20:09.725178    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf\": container with ID starting with b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf not found: ID does not exist" containerID="b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf"
Jul 23 16:20:09.725260 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.725202    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf"} err="failed to get container status \"b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf\": rpc error: code = NotFound desc = could not find container \"b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf\": container with ID starting with b0d3074a9d10fe374c4655c87bfde9c9bae6f90a1b62a71c8aa77fcde7c51aaf not found: ID does not exist"
Jul 23 16:20:09.733561 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.733535    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754b7466b4-xxsn9"]
Jul 23 16:20:09.738705 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:09.738684    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-754b7466b4-xxsn9"]
Jul 23 16:20:11.591802 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:11.591770    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f83af881-efcc-4677-867f-58735db7c53b" path="/var/lib/kubelet/pods/f83af881-efcc-4677-867f-58735db7c53b/volumes"
Jul 23 16:20:40.833326 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.833296    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"]
Jul 23 16:20:40.833790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.833592    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f83af881-efcc-4677-867f-58735db7c53b" containerName="console"
Jul 23 16:20:40.833790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.833602    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f83af881-efcc-4677-867f-58735db7c53b" containerName="console"
Jul 23 16:20:40.833790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.833659    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f83af881-efcc-4677-867f-58735db7c53b" containerName="console"
Jul 23 16:20:40.836481 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.836460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.839324 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.839295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 16:20:40.839324 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.839307    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 16:20:40.839496 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.839311    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 16:20:40.840499 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.840469    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 16:20:40.840627 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.840502    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 16:20:40.840627 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.840526    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 16:20:40.840627 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.840595    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 16:20:40.846772 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.846747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"]
Jul 23 16:20:40.887782 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.887743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/268119ce-c547-43e4-8e32-66a5a2e8b7d0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.887972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.887791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bgf\" (UniqueName: \"kubernetes.io/projected/268119ce-c547-43e4-8e32-66a5a2e8b7d0-kube-api-access-w7bgf\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.887972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.887811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-hub\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.887972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.887892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-ca\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.887972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.887931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.887972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.887959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.988524 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.988483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.988711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.988562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/268119ce-c547-43e4-8e32-66a5a2e8b7d0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.988711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.988595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bgf\" (UniqueName: \"kubernetes.io/projected/268119ce-c547-43e4-8e32-66a5a2e8b7d0-kube-api-access-w7bgf\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.988711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.988618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-hub\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.988711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.988651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-ca\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.988711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.988673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.989474 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.989447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/268119ce-c547-43e4-8e32-66a5a2e8b7d0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.991197 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.991173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.991335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.991239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-ca\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.991335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.991299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-hub\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.991407 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.991327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/268119ce-c547-43e4-8e32-66a5a2e8b7d0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:40.998683 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:40.998660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bgf\" (UniqueName: \"kubernetes.io/projected/268119ce-c547-43e4-8e32-66a5a2e8b7d0-kube-api-access-w7bgf\") pod \"cluster-proxy-proxy-agent-c77bfbfcf-4c64q\" (UID: \"268119ce-c547-43e4-8e32-66a5a2e8b7d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:41.161898 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:41.161824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"
Jul 23 16:20:41.293233 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:41.293167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q"]
Jul 23 16:20:41.295545 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:20:41.295518    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod268119ce_c547_43e4_8e32_66a5a2e8b7d0.slice/crio-78b52e932debe706e4a1c14ed86332a156723a46ea5be8db4cb0595a4aee95a4 WatchSource:0}: Error finding container 78b52e932debe706e4a1c14ed86332a156723a46ea5be8db4cb0595a4aee95a4: Status 404 returned error can't find the container with id 78b52e932debe706e4a1c14ed86332a156723a46ea5be8db4cb0595a4aee95a4
Jul 23 16:20:41.837734 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:41.837698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q" event={"ID":"268119ce-c547-43e4-8e32-66a5a2e8b7d0","Type":"ContainerStarted","Data":"78b52e932debe706e4a1c14ed86332a156723a46ea5be8db4cb0595a4aee95a4"}
Jul 23 16:20:45.856941 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:45.856903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q" event={"ID":"268119ce-c547-43e4-8e32-66a5a2e8b7d0","Type":"ContainerStarted","Data":"35b22176d0ae9de8cba9416820f4b4eceb36a1929aa7b910ab3c788c32a4acd1"}
Jul 23 16:20:45.856941 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:45.856949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q" event={"ID":"268119ce-c547-43e4-8e32-66a5a2e8b7d0","Type":"ContainerStarted","Data":"0d89da73b97266cb4bc421458e4cbeebe39c220689517efbd0345eef351d914f"}
Jul 23 16:20:45.857361 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:45.856961    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q" event={"ID":"268119ce-c547-43e4-8e32-66a5a2e8b7d0","Type":"ContainerStarted","Data":"9239c653f9fe6c91eaaa7a3779853146555179843309a96bead0a9ee58f022b5"}
Jul 23 16:20:45.876628 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:45.876562    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c77bfbfcf-4c64q" podStartSLOduration=2.325696887 podStartE2EDuration="5.876545384s" totalImagesPullingTime="3.550848497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:20:45.874872076 +0000 UTC m=+299.280239326" watchObservedRunningTime="2026-07-23 16:20:45.876545384 +0000 UTC m=+299.281912684"
Jul 23 16:20:47.189887 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:20:47.189863    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 16:21:56.367978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.367943    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"]
Jul 23 16:21:56.370537 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.370518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.374442 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.374415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 16:21:56.374724 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.374704    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 16:21:56.374813 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.374753    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2hj9\""
Jul 23 16:21:56.375491 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.375478    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 16:21:56.378087 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.378071    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 16:21:56.400734 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.400708    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"]
Jul 23 16:21:56.419372 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.419340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe9bc931-68fe-4b72-9394-9f63e9087f54-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.419545 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.419388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe9bc931-68fe-4b72-9394-9f63e9087f54-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.419545 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.419524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe9bc931-68fe-4b72-9394-9f63e9087f54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.419672 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.419560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hskkk\" (UniqueName: \"kubernetes.io/projected/fe9bc931-68fe-4b72-9394-9f63e9087f54-kube-api-access-hskkk\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.419672 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.419612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9bc931-68fe-4b72-9394-9f63e9087f54-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.520506 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.520467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe9bc931-68fe-4b72-9394-9f63e9087f54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.520716 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.520508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hskkk\" (UniqueName: \"kubernetes.io/projected/fe9bc931-68fe-4b72-9394-9f63e9087f54-kube-api-access-hskkk\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.520716 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.520541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9bc931-68fe-4b72-9394-9f63e9087f54-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.520716 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.520568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe9bc931-68fe-4b72-9394-9f63e9087f54-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.520716 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.520625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe9bc931-68fe-4b72-9394-9f63e9087f54-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.521057 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.521037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe9bc931-68fe-4b72-9394-9f63e9087f54-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.522958 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.522940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe9bc931-68fe-4b72-9394-9f63e9087f54-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.523056 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.523038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9bc931-68fe-4b72-9394-9f63e9087f54-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.523114 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.523073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe9bc931-68fe-4b72-9394-9f63e9087f54-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.529125 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.529106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hskkk\" (UniqueName: \"kubernetes.io/projected/fe9bc931-68fe-4b72-9394-9f63e9087f54-kube-api-access-hskkk\") pod \"opendatahub-operator-controller-manager-678945769f-w4x6h\" (UID: \"fe9bc931-68fe-4b72-9394-9f63e9087f54\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.679972 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.679891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:21:56.838101 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.837996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"]
Jul 23 16:21:56.841755 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:21:56.841730    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9bc931_68fe_4b72_9394_9f63e9087f54.slice/crio-eba485d50e7235e5d3b56429153a6c18c7a80b3d90f11de1dea43c92642812bc WatchSource:0}: Error finding container eba485d50e7235e5d3b56429153a6c18c7a80b3d90f11de1dea43c92642812bc: Status 404 returned error can't find the container with id eba485d50e7235e5d3b56429153a6c18c7a80b3d90f11de1dea43c92642812bc
Jul 23 16:21:56.843869 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:56.843835    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:21:57.116413 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:21:57.116383    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h" event={"ID":"fe9bc931-68fe-4b72-9394-9f63e9087f54","Type":"ContainerStarted","Data":"eba485d50e7235e5d3b56429153a6c18c7a80b3d90f11de1dea43c92642812bc"}
Jul 23 16:22:00.131534 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:00.131499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h" event={"ID":"fe9bc931-68fe-4b72-9394-9f63e9087f54","Type":"ContainerStarted","Data":"e89253d3d76d466bab2389e6b678d9a1617a6bc24d5c32e849450bf4241c1b4e"}
Jul 23 16:22:01.137440 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:01.137357    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe9bc931-68fe-4b72-9394-9f63e9087f54" containerID="e89253d3d76d466bab2389e6b678d9a1617a6bc24d5c32e849450bf4241c1b4e" exitCode=0
Jul 23 16:22:01.137440 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:01.137414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h" event={"ID":"fe9bc931-68fe-4b72-9394-9f63e9087f54","Type":"ContainerDied","Data":"e89253d3d76d466bab2389e6b678d9a1617a6bc24d5c32e849450bf4241c1b4e"}
Jul 23 16:22:02.142819 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:02.142788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h" event={"ID":"fe9bc931-68fe-4b72-9394-9f63e9087f54","Type":"ContainerStarted","Data":"a2ab35050917e5cb02725546ff514df865ed7e4fc1829408c5dcd7e51726bd48"}
Jul 23 16:22:02.143224 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:02.142895    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:22:02.168192 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:02.168142    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h" podStartSLOduration=1.725800843 podStartE2EDuration="6.16812563s" totalImagesPullingTime="3.394513191s" totalInitContainerRuntime="1.047811596s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:02.166293968 +0000 UTC m=+375.571661248" watchObservedRunningTime="2026-07-23 16:22:02.16812563 +0000 UTC m=+375.573492888"
Jul 23 16:22:13.149374 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:13.149347    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-w4x6h"
Jul 23 16:22:23.657997 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.657960    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"]
Jul 23 16:22:23.664124 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.664100    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.669755 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.669727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:22:23.670237 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.670206    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 16:22:23.671322 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.671304    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 16:22:23.671433 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.671324    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 16:22:23.671433 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.671369    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z65b7\""
Jul 23 16:22:23.671433 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.671324    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 16:22:23.676161 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.676137    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"]
Jul 23 16:22:23.763355 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.763318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-manager-config\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.763547 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.763368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jf7\" (UniqueName: \"kubernetes.io/projected/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-kube-api-access-h4jf7\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.763547 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.763414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-metrics-cert\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.763547 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.763488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-cert\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.864159 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.864122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jf7\" (UniqueName: \"kubernetes.io/projected/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-kube-api-access-h4jf7\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.864329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.864172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-metrics-cert\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.864329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.864219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-cert\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.864329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.864243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-manager-config\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.865046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.865019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-manager-config\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.866864 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.866828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-metrics-cert\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.867172 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.867151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-cert\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.877066 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.877034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jf7\" (UniqueName: \"kubernetes.io/projected/0b64b3f5-40e3-4c0d-9974-bb25f2575b9c-kube-api-access-h4jf7\") pod \"lws-controller-manager-598cd96689-xvcx4\" (UID: \"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:23.972961 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:23.972874    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:24.121872 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:24.121834    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"]
Jul 23 16:22:24.124248 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:22:24.124223    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b64b3f5_40e3_4c0d_9974_bb25f2575b9c.slice/crio-4fb7a57f536590a47b7f24dc7da111b52e63d93340505f20b7cd1b0766a3773b WatchSource:0}: Error finding container 4fb7a57f536590a47b7f24dc7da111b52e63d93340505f20b7cd1b0766a3773b: Status 404 returned error can't find the container with id 4fb7a57f536590a47b7f24dc7da111b52e63d93340505f20b7cd1b0766a3773b
Jul 23 16:22:24.234217 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:24.234131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4" event={"ID":"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c","Type":"ContainerStarted","Data":"4fb7a57f536590a47b7f24dc7da111b52e63d93340505f20b7cd1b0766a3773b"}
Jul 23 16:22:25.827138 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.827106    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"]
Jul 23 16:22:25.831004 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.830979    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:25.834290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.834266    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ztnqk\""
Jul 23 16:22:25.836164 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.836146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 16:22:25.848191 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.848133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"]
Jul 23 16:22:25.849825 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.849800    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"]
Jul 23 16:22:25.852947 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.852928    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:25.855826 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.855806    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 16:22:25.855955 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.855808    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-z74mx\""
Jul 23 16:22:25.861496 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.861431    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"]
Jul 23 16:22:25.883746 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.883706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:25.883977 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.883807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5nxz\" (UniqueName: \"kubernetes.io/projected/768413ad-f9d1-453b-aefc-3e818f52a578-kube-api-access-x5nxz\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:25.883977 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.883900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqtj\" (UniqueName: \"kubernetes.io/projected/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-kube-api-access-4jqtj\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:25.883977 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.883949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/768413ad-f9d1-453b-aefc-3e818f52a578-cert\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:25.985123 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.985084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqtj\" (UniqueName: \"kubernetes.io/projected/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-kube-api-access-4jqtj\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:25.985305 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.985142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/768413ad-f9d1-453b-aefc-3e818f52a578-cert\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:25.985305 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.985188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:25.985305 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.985221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5nxz\" (UniqueName: \"kubernetes.io/projected/768413ad-f9d1-453b-aefc-3e818f52a578-kube-api-access-x5nxz\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:25.985469 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:22:25.985324    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 16:22:25.985469 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:22:25.985327    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 16:22:25.985469 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:22:25.985398    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768413ad-f9d1-453b-aefc-3e818f52a578-cert podName:768413ad-f9d1-453b-aefc-3e818f52a578 nodeName:}" failed. No retries permitted until 2026-07-23 16:22:26.485382384 +0000 UTC m=+399.890749623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/768413ad-f9d1-453b-aefc-3e818f52a578-cert") pod "kserve-controller-manager-d6f4b65b8-vgtnp" (UID: "768413ad-f9d1-453b-aefc-3e818f52a578") : secret "kserve-webhook-server-cert" not found
Jul 23 16:22:25.985469 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:22:25.985428    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-cert podName:bd3cd3fd-79c0-4590-8732-5f6aa0e7329d nodeName:}" failed. No retries permitted until 2026-07-23 16:22:26.485411734 +0000 UTC m=+399.890778971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-cert") pod "llmisvc-controller-manager-777c6bd7d5-w5v46" (UID: "bd3cd3fd-79c0-4590-8732-5f6aa0e7329d") : secret "llmisvc-webhook-server-cert" not found
Jul 23 16:22:25.995962 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.995903    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqtj\" (UniqueName: \"kubernetes.io/projected/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-kube-api-access-4jqtj\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:25.997474 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:25.997443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5nxz\" (UniqueName: \"kubernetes.io/projected/768413ad-f9d1-453b-aefc-3e818f52a578-kube-api-access-x5nxz\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:26.488993 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.488956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/768413ad-f9d1-453b-aefc-3e818f52a578-cert\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:26.489192 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.489055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:26.492103 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.492071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd3cd3fd-79c0-4590-8732-5f6aa0e7329d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-w5v46\" (UID: \"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:26.492103 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.492089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/768413ad-f9d1-453b-aefc-3e818f52a578-cert\") pod \"kserve-controller-manager-d6f4b65b8-vgtnp\" (UID: \"768413ad-f9d1-453b-aefc-3e818f52a578\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:26.743410 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.743307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:26.766335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.766297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:26.921487 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.921461    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"]
Jul 23 16:22:26.927820 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:22:26.927773    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768413ad_f9d1_453b_aefc_3e818f52a578.slice/crio-71cf0b465868666237fcf22a9faeeec042dcddc0b6867285e8e63e80a7cd76d5 WatchSource:0}: Error finding container 71cf0b465868666237fcf22a9faeeec042dcddc0b6867285e8e63e80a7cd76d5: Status 404 returned error can't find the container with id 71cf0b465868666237fcf22a9faeeec042dcddc0b6867285e8e63e80a7cd76d5
Jul 23 16:22:26.951352 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:26.951331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"]
Jul 23 16:22:26.953258 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:22:26.953226    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd3cd3fd_79c0_4590_8732_5f6aa0e7329d.slice/crio-7c7f7602ac36449f217b97e06e55daa10a89bdab2044783819c8e78901848be6 WatchSource:0}: Error finding container 7c7f7602ac36449f217b97e06e55daa10a89bdab2044783819c8e78901848be6: Status 404 returned error can't find the container with id 7c7f7602ac36449f217b97e06e55daa10a89bdab2044783819c8e78901848be6
Jul 23 16:22:27.251633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:27.251599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp" event={"ID":"768413ad-f9d1-453b-aefc-3e818f52a578","Type":"ContainerStarted","Data":"71cf0b465868666237fcf22a9faeeec042dcddc0b6867285e8e63e80a7cd76d5"}
Jul 23 16:22:27.252775 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:27.252747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46" event={"ID":"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d","Type":"ContainerStarted","Data":"7c7f7602ac36449f217b97e06e55daa10a89bdab2044783819c8e78901848be6"}
Jul 23 16:22:27.254073 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:27.254054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4" event={"ID":"0b64b3f5-40e3-4c0d-9974-bb25f2575b9c","Type":"ContainerStarted","Data":"a3e39bc8426a9f081b98a38408646f5e6a85b67852dfab855d8725259b9aa4b1"}
Jul 23 16:22:27.254279 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:27.254262    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:22:27.299334 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:27.299285    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4" podStartSLOduration=1.881942218 podStartE2EDuration="4.299269092s" totalImagesPullingTime="2.417326874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:27.296401662 +0000 UTC m=+400.701768920" watchObservedRunningTime="2026-07-23 16:22:27.299269092 +0000 UTC m=+400.704636350"
Jul 23 16:22:31.275577 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:31.275541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp" event={"ID":"768413ad-f9d1-453b-aefc-3e818f52a578","Type":"ContainerStarted","Data":"a56fcc98b07fc4fd1f93ac141d3d7827a08edb5e92d157cef9fe4d2ef26a87b1"}
Jul 23 16:22:31.276028 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:31.275609    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:22:31.277136 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:31.277110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46" event={"ID":"bd3cd3fd-79c0-4590-8732-5f6aa0e7329d","Type":"ContainerStarted","Data":"5d9262fe933fb962dd2dc199a665664c41cbac3fa2f50b180289fa9e803387e3"}
Jul 23 16:22:31.277245 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:31.277233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:22:31.297201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:31.297154    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp" podStartSLOduration=2.950011012 podStartE2EDuration="6.297140504s" totalImagesPullingTime="3.347129492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:31.296337326 +0000 UTC m=+404.701704585" watchObservedRunningTime="2026-07-23 16:22:31.297140504 +0000 UTC m=+404.702507808"
Jul 23 16:22:31.319229 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:31.319174    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46" podStartSLOduration=3.000556658 podStartE2EDuration="6.31915991s" totalImagesPullingTime="3.318603252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:31.317354118 +0000 UTC m=+404.722721377" watchObservedRunningTime="2026-07-23 16:22:31.31915991 +0000 UTC m=+404.724527221"
Jul 23 16:22:38.263447 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:22:38.263415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-598cd96689-xvcx4"
Jul 23 16:23:02.283457 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:02.283425    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-w5v46"
Jul 23 16:23:02.286314 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:02.286295    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vgtnp"
Jul 23 16:23:17.398435 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.398362    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ps54k"]
Jul 23 16:23:17.400804 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.400789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:17.403790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.403766    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 16:23:17.403975 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.403959    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 16:23:17.404979 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.404963    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9dq4r\""
Jul 23 16:23:17.408971 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.408951    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ps54k"]
Jul 23 16:23:17.424997 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.424968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gpx6\" (UniqueName: \"kubernetes.io/projected/850ce2e2-7308-4723-b900-35faf1db21b5-kube-api-access-2gpx6\") pod \"kuadrant-operator-catalog-ps54k\" (UID: \"850ce2e2-7308-4723-b900-35faf1db21b5\") " pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:17.526311 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.526283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gpx6\" (UniqueName: \"kubernetes.io/projected/850ce2e2-7308-4723-b900-35faf1db21b5-kube-api-access-2gpx6\") pod \"kuadrant-operator-catalog-ps54k\" (UID: \"850ce2e2-7308-4723-b900-35faf1db21b5\") " pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:17.536321 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.536296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gpx6\" (UniqueName: \"kubernetes.io/projected/850ce2e2-7308-4723-b900-35faf1db21b5-kube-api-access-2gpx6\") pod \"kuadrant-operator-catalog-ps54k\" (UID: \"850ce2e2-7308-4723-b900-35faf1db21b5\") " pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:17.711497 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.711420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:17.840047 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:17.840023    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ps54k"]
Jul 23 16:23:17.841866 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:23:17.841825    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850ce2e2_7308_4723_b900_35faf1db21b5.slice/crio-da98af55d736157427ef0be7446103aa205053fa40ea7260b2ff16aa6c2d3bf6 WatchSource:0}: Error finding container da98af55d736157427ef0be7446103aa205053fa40ea7260b2ff16aa6c2d3bf6: Status 404 returned error can't find the container with id da98af55d736157427ef0be7446103aa205053fa40ea7260b2ff16aa6c2d3bf6
Jul 23 16:23:18.474327 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:18.474296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ps54k" event={"ID":"850ce2e2-7308-4723-b900-35faf1db21b5","Type":"ContainerStarted","Data":"da98af55d736157427ef0be7446103aa205053fa40ea7260b2ff16aa6c2d3bf6"}
Jul 23 16:23:20.484510 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:20.484474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ps54k" event={"ID":"850ce2e2-7308-4723-b900-35faf1db21b5","Type":"ContainerStarted","Data":"9c244d8a011d5ae29b426af2d7694f9201f480d4ff8426d6f831c305a1d883a4"}
Jul 23 16:23:23.360774 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.360711    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ps54k" podStartSLOduration=4.492704812 podStartE2EDuration="6.360693514s" totalImagesPullingTime="1.867988702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:23:20.500811379 +0000 UTC m=+453.906178638" watchObservedRunningTime="2026-07-23 16:23:23.360693514 +0000 UTC m=+456.766060771"
Jul 23 16:23:23.361869 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.361833    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c745548d7-c7r4r"]
Jul 23 16:23:23.365294 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.365277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.375247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.375221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c745548d7-c7r4r"]
Jul 23 16:23:23.476582 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-trusted-ca-bundle\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.476582 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-oauth-serving-cert\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.476797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwlcc\" (UniqueName: \"kubernetes.io/projected/9c30b60b-b733-4c09-a01a-f8c5dde976b6-kube-api-access-kwlcc\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.476797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-serving-cert\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.476797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-config\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.476797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-oauth-config\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.476949 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.476864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-service-ca\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577613 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-oauth-serving-cert\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577613 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwlcc\" (UniqueName: \"kubernetes.io/projected/9c30b60b-b733-4c09-a01a-f8c5dde976b6-kube-api-access-kwlcc\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-serving-cert\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-config\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-oauth-config\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-service-ca\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.577835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.577811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-trusted-ca-bundle\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.578438 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.578415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-oauth-serving-cert\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.578549 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.578418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-config\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.578549 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.578523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-service-ca\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.578717 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.578694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c30b60b-b733-4c09-a01a-f8c5dde976b6-trusted-ca-bundle\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.580302 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.580275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-serving-cert\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.580413 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.580360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c30b60b-b733-4c09-a01a-f8c5dde976b6-console-oauth-config\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.586403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.586377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwlcc\" (UniqueName: \"kubernetes.io/projected/9c30b60b-b733-4c09-a01a-f8c5dde976b6-kube-api-access-kwlcc\") pod \"console-7c745548d7-c7r4r\" (UID: \"9c30b60b-b733-4c09-a01a-f8c5dde976b6\") " pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.675532 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.675495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:23.805381 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:23.805354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c745548d7-c7r4r"]
Jul 23 16:23:23.807238 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:23:23.807206    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c30b60b_b733_4c09_a01a_f8c5dde976b6.slice/crio-865668c18303e0132b17f0688588d525090789e3001c0b5f2aeb38933d168fd0 WatchSource:0}: Error finding container 865668c18303e0132b17f0688588d525090789e3001c0b5f2aeb38933d168fd0: Status 404 returned error can't find the container with id 865668c18303e0132b17f0688588d525090789e3001c0b5f2aeb38933d168fd0
Jul 23 16:23:24.502866 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:24.502816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c745548d7-c7r4r" event={"ID":"9c30b60b-b733-4c09-a01a-f8c5dde976b6","Type":"ContainerStarted","Data":"274fb70e5c323df191a0d86eab95861f54066aaf8df40e67d86c33c54f9dbe70"}
Jul 23 16:23:24.503229 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:24.502885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c745548d7-c7r4r" event={"ID":"9c30b60b-b733-4c09-a01a-f8c5dde976b6","Type":"ContainerStarted","Data":"865668c18303e0132b17f0688588d525090789e3001c0b5f2aeb38933d168fd0"}
Jul 23 16:23:24.522302 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:24.522248    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c745548d7-c7r4r" podStartSLOduration=1.522228024 podStartE2EDuration="1.522228024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:23:24.521293682 +0000 UTC m=+457.926660943" watchObservedRunningTime="2026-07-23 16:23:24.522228024 +0000 UTC m=+457.927595283"
Jul 23 16:23:27.712078 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:27.712039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:27.712485 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:27.712103    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:27.734547 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:27.734520    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:28.541661 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:28.541636    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ps54k"
Jul 23 16:23:33.676104 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:33.676063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:33.676643 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:33.676123    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:33.680876 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:33.680839    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:34.550156 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:34.550127    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c745548d7-c7r4r"
Jul 23 16:23:34.595271 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:34.595228    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffb4777d6-rf6vb"]
Jul 23 16:23:53.453654 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.453620    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"]
Jul 23 16:23:53.458103 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.458086    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:23:53.462227 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.462204    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tlv29\""
Jul 23 16:23:53.477831 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.477802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"]
Jul 23 16:23:53.651572 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.651534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpsgd\" (UniqueName: \"kubernetes.io/projected/1e903b7e-6e6d-4fff-97da-f84b04dcb852-kube-api-access-fpsgd\") pod \"authorino-operator-75cc8d5cb7-rh9wl\" (UID: \"1e903b7e-6e6d-4fff-97da-f84b04dcb852\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:23:53.753148 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.753042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpsgd\" (UniqueName: \"kubernetes.io/projected/1e903b7e-6e6d-4fff-97da-f84b04dcb852-kube-api-access-fpsgd\") pod \"authorino-operator-75cc8d5cb7-rh9wl\" (UID: \"1e903b7e-6e6d-4fff-97da-f84b04dcb852\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:23:53.764217 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.764153    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpsgd\" (UniqueName: \"kubernetes.io/projected/1e903b7e-6e6d-4fff-97da-f84b04dcb852-kube-api-access-fpsgd\") pod \"authorino-operator-75cc8d5cb7-rh9wl\" (UID: \"1e903b7e-6e6d-4fff-97da-f84b04dcb852\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:23:53.768551 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.768515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:23:53.929534 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:53.929503    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"]
Jul 23 16:23:53.932647 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:23:53.932615    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e903b7e_6e6d_4fff_97da_f84b04dcb852.slice/crio-32e014af9e2da54354711701eb36ebc628ac20027bc842269a1663f721f981c1 WatchSource:0}: Error finding container 32e014af9e2da54354711701eb36ebc628ac20027bc842269a1663f721f981c1: Status 404 returned error can't find the container with id 32e014af9e2da54354711701eb36ebc628ac20027bc842269a1663f721f981c1
Jul 23 16:23:54.631090 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:54.631054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl" event={"ID":"1e903b7e-6e6d-4fff-97da-f84b04dcb852","Type":"ContainerStarted","Data":"32e014af9e2da54354711701eb36ebc628ac20027bc842269a1663f721f981c1"}
Jul 23 16:23:56.642932 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:56.642896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl" event={"ID":"1e903b7e-6e6d-4fff-97da-f84b04dcb852","Type":"ContainerStarted","Data":"b984201b482d44d5402ae364c8a4a21b84b91b31c0521c54748b969eccdefa8a"}
Jul 23 16:23:56.643344 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:56.643046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:23:56.660023 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:56.659978    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl" podStartSLOduration=1.2716176510000001 podStartE2EDuration="3.659963233s" totalImagesPullingTime="2.388345582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:23:56.65924425 +0000 UTC m=+490.064611510" watchObservedRunningTime="2026-07-23 16:23:56.659963233 +0000 UTC m=+490.065330493"
Jul 23 16:23:59.619738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.619664    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ffb4777d6-rf6vb" podUID="19d6ad4d-aef9-453a-a640-711f450282a2" containerName="console" containerID="cri-o://7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe" gracePeriod=15
Jul 23 16:23:59.863089 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.863061    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:23:59.922763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-trusted-ca-bundle\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.922763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-oauth-serving-cert\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.923015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-serving-cert\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.923015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-console-config\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.923015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922868    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-service-ca\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.923015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s62mg\" (UniqueName: \"kubernetes.io/projected/19d6ad4d-aef9-453a-a640-711f450282a2-kube-api-access-s62mg\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.923015 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.922929    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-oauth-config\") pod \"19d6ad4d-aef9-453a-a640-711f450282a2\" (UID: \"19d6ad4d-aef9-453a-a640-711f450282a2\") "
Jul 23 16:23:59.923290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.923257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-console-config" (OuterVolumeSpecName: "console-config") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:23:59.923290 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.923277    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:23:59.923398 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.923163    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:23:59.923398 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.923302    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:23:59.925016 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.924982    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d6ad4d-aef9-453a-a640-711f450282a2-kube-api-access-s62mg" (OuterVolumeSpecName: "kube-api-access-s62mg") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "kube-api-access-s62mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:23:59.925016 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.924989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:23:59.925177 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:23:59.925114    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19d6ad4d-aef9-453a-a640-711f450282a2" (UID: "19d6ad4d-aef9-453a-a640-711f450282a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:24:00.024000 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.023965    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.024000 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.023994    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-oauth-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.024000 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.024003    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.024000 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.024013    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-console-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.024265 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.024022    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19d6ad4d-aef9-453a-a640-711f450282a2-service-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.024265 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.024030    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s62mg\" (UniqueName: \"kubernetes.io/projected/19d6ad4d-aef9-453a-a640-711f450282a2-kube-api-access-s62mg\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.024265 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.024039    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19d6ad4d-aef9-453a-a640-711f450282a2-console-oauth-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:24:00.662509 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.662478    2582 generic.go:356] "Generic (PLEG): container finished" podID="19d6ad4d-aef9-453a-a640-711f450282a2" containerID="7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe" exitCode=0
Jul 23 16:24:00.662937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.662523    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb4777d6-rf6vb"
Jul 23 16:24:00.662937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.662561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb4777d6-rf6vb" event={"ID":"19d6ad4d-aef9-453a-a640-711f450282a2","Type":"ContainerDied","Data":"7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe"}
Jul 23 16:24:00.662937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.662611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb4777d6-rf6vb" event={"ID":"19d6ad4d-aef9-453a-a640-711f450282a2","Type":"ContainerDied","Data":"9785bc2a12d3327a312388364686589a898a5191756ee84db34fa0cd66789c6f"}
Jul 23 16:24:00.662937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.662635    2582 scope.go:117] "RemoveContainer" containerID="7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe"
Jul 23 16:24:00.671829 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.671813    2582 scope.go:117] "RemoveContainer" containerID="7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe"
Jul 23 16:24:00.672092 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:24:00.672072    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe\": container with ID starting with 7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe not found: ID does not exist" containerID="7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe"
Jul 23 16:24:00.672145 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.672100    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe"} err="failed to get container status \"7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe\": rpc error: code = NotFound desc = could not find container \"7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe\": container with ID starting with 7d7cd10cce76bfe091a7dbfb1967b657315f44cca19078eac0c5c4c1290884fe not found: ID does not exist"
Jul 23 16:24:00.684483 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.684457    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffb4777d6-rf6vb"]
Jul 23 16:24:00.694665 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:00.694637    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ffb4777d6-rf6vb"]
Jul 23 16:24:01.593355 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:01.593322    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19d6ad4d-aef9-453a-a640-711f450282a2" path="/var/lib/kubelet/pods/19d6ad4d-aef9-453a-a640-711f450282a2/volumes"
Jul 23 16:24:07.649769 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:07.649733    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rh9wl"
Jul 23 16:24:11.483575 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.483535    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"]
Jul 23 16:24:11.484069 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.484020    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d6ad4d-aef9-453a-a640-711f450282a2" containerName="console"
Jul 23 16:24:11.484069 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.484036    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d6ad4d-aef9-453a-a640-711f450282a2" containerName="console"
Jul 23 16:24:11.484180 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.484150    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d6ad4d-aef9-453a-a640-711f450282a2" containerName="console"
Jul 23 16:24:11.486951 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.486930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.489898 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.489881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7w4z4\""
Jul 23 16:24:11.501589 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.501565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"]
Jul 23 16:24:11.623743 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.623708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f3b196-7b71-4340-9a29-518e75b179e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m5rzk\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.623942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.623779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmbrt\" (UniqueName: \"kubernetes.io/projected/94f3b196-7b71-4340-9a29-518e75b179e4-kube-api-access-dmbrt\") pod \"kuadrant-operator-controller-manager-86878c769f-m5rzk\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.724335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.724299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmbrt\" (UniqueName: \"kubernetes.io/projected/94f3b196-7b71-4340-9a29-518e75b179e4-kube-api-access-dmbrt\") pod \"kuadrant-operator-controller-manager-86878c769f-m5rzk\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.724502 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.724355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f3b196-7b71-4340-9a29-518e75b179e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m5rzk\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.724694 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.724679    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f3b196-7b71-4340-9a29-518e75b179e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m5rzk\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.740177 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.740108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmbrt\" (UniqueName: \"kubernetes.io/projected/94f3b196-7b71-4340-9a29-518e75b179e4-kube-api-access-dmbrt\") pod \"kuadrant-operator-controller-manager-86878c769f-m5rzk\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.797109 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.797068    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:11.937358 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:11.937336    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"]
Jul 23 16:24:11.939369 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:24:11.939345    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f3b196_7b71_4340_9a29_518e75b179e4.slice/crio-ed505cbd462b52edbe5b0f9bcc275a399043d9714ed1d29dae4e7653d9c90667 WatchSource:0}: Error finding container ed505cbd462b52edbe5b0f9bcc275a399043d9714ed1d29dae4e7653d9c90667: Status 404 returned error can't find the container with id ed505cbd462b52edbe5b0f9bcc275a399043d9714ed1d29dae4e7653d9c90667
Jul 23 16:24:12.728450 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:12.728410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk" event={"ID":"94f3b196-7b71-4340-9a29-518e75b179e4","Type":"ContainerStarted","Data":"ed505cbd462b52edbe5b0f9bcc275a399043d9714ed1d29dae4e7653d9c90667"}
Jul 23 16:24:16.749798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:16.749758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk" event={"ID":"94f3b196-7b71-4340-9a29-518e75b179e4","Type":"ContainerStarted","Data":"2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e"}
Jul 23 16:24:16.750233 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:16.749892    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:16.800981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:16.800930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk" podStartSLOduration=1.759397111 podStartE2EDuration="5.8009144s" totalImagesPullingTime="4.041517289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:16.798223158 +0000 UTC m=+510.203590415" watchObservedRunningTime="2026-07-23 16:24:16.8009144 +0000 UTC m=+510.206281725"
Jul 23 16:24:27.756406 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:27.756372    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:24:47.163438 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.163403    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:24:47.166150 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.166130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.169286 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.169263    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 16:24:47.169537 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.169523    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tgxk6\""
Jul 23 16:24:47.177243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.177223    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:24:47.217215 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.217183    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:24:47.233565 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.233529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z49jj\" (UniqueName: \"kubernetes.io/projected/01ccdf84-3213-41d2-9d2c-57c165a92054-kube-api-access-z49jj\") pod \"limitador-limitador-54d6d988d5-gcffz\" (UID: \"01ccdf84-3213-41d2-9d2c-57c165a92054\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.233770 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.233578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/01ccdf84-3213-41d2-9d2c-57c165a92054-config-file\") pod \"limitador-limitador-54d6d988d5-gcffz\" (UID: \"01ccdf84-3213-41d2-9d2c-57c165a92054\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.334158 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.334121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z49jj\" (UniqueName: \"kubernetes.io/projected/01ccdf84-3213-41d2-9d2c-57c165a92054-kube-api-access-z49jj\") pod \"limitador-limitador-54d6d988d5-gcffz\" (UID: \"01ccdf84-3213-41d2-9d2c-57c165a92054\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.334158 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.334167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/01ccdf84-3213-41d2-9d2c-57c165a92054-config-file\") pod \"limitador-limitador-54d6d988d5-gcffz\" (UID: \"01ccdf84-3213-41d2-9d2c-57c165a92054\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.334745 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.334727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/01ccdf84-3213-41d2-9d2c-57c165a92054-config-file\") pod \"limitador-limitador-54d6d988d5-gcffz\" (UID: \"01ccdf84-3213-41d2-9d2c-57c165a92054\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.343185 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.343155    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z49jj\" (UniqueName: \"kubernetes.io/projected/01ccdf84-3213-41d2-9d2c-57c165a92054-kube-api-access-z49jj\") pod \"limitador-limitador-54d6d988d5-gcffz\" (UID: \"01ccdf84-3213-41d2-9d2c-57c165a92054\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.478219 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.478148    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:47.617090 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.617064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:24:47.618823 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:24:47.618796    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ccdf84_3213_41d2_9d2c_57c165a92054.slice/crio-097814f79d4e65446f68a3c02fa480b50c0c81b9a68d67ebc3c09be07aa779d8 WatchSource:0}: Error finding container 097814f79d4e65446f68a3c02fa480b50c0c81b9a68d67ebc3c09be07aa779d8: Status 404 returned error can't find the container with id 097814f79d4e65446f68a3c02fa480b50c0c81b9a68d67ebc3c09be07aa779d8
Jul 23 16:24:47.894721 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:47.894686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz" event={"ID":"01ccdf84-3213-41d2-9d2c-57c165a92054","Type":"ContainerStarted","Data":"097814f79d4e65446f68a3c02fa480b50c0c81b9a68d67ebc3c09be07aa779d8"}
Jul 23 16:24:50.911684 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:50.911645    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz" event={"ID":"01ccdf84-3213-41d2-9d2c-57c165a92054","Type":"ContainerStarted","Data":"ba115ec964835da0cdbd8a2ec8c31f1d427a37aeabc6daab10c9f054d642ef18"}
Jul 23 16:24:50.912095 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:50.911781    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:24:50.929800 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:24:50.929748    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz" podStartSLOduration=1.5787002 podStartE2EDuration="3.929732372s" totalImagesPullingTime="2.351032172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:50.928593748 +0000 UTC m=+544.333961005" watchObservedRunningTime="2026-07-23 16:24:50.929732372 +0000 UTC m=+544.335099631"
Jul 23 16:25:01.917804 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:25:01.917771    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gcffz"
Jul 23 16:26:05.848342 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:26:05.848311    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:26:38.030679 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:26:38.030608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:26:49.128897 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:26:49.128859    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:27:09.431531 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:09.431497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:27:17.522593 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.522563    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"]
Jul 23 16:27:17.526133 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.526112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.529066 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.529042    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 16:27:17.529207 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.529053    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 16:27:17.529207 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.529087    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jvnq5\""
Jul 23 16:27:17.529207 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.529187    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 16:27:17.535476 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.535453    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"]
Jul 23 16:27:17.667519 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.667476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.667704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.667536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.667704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.667575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxwzw\" (UniqueName: \"kubernetes.io/projected/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-kube-api-access-rxwzw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.667704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.667603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.667704 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.667639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.667926 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.667700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.768781 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.768738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxwzw\" (UniqueName: \"kubernetes.io/projected/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-kube-api-access-rxwzw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.768987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.768796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.768987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.768834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.768987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.768894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.768987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.768973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.769202 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.769004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.769355 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.769321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.769479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.769331    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.769479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.769404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.771596 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.771547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.771727 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.771676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.777338 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.777277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxwzw\" (UniqueName: \"kubernetes.io/projected/62ef9974-f01f-4b9f-af91-9bcd2ab2d97e-kube-api-access-rxwzw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2\" (UID: \"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.839296 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.839257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:17.971039 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.971010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"]
Jul 23 16:27:17.973087 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:27:17.973049    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ef9974_f01f_4b9f_af91_9bcd2ab2d97e.slice/crio-ccb46d3679181c3850abe45e19371d8c5ba7eafee30564dee334d7fa0afb2525 WatchSource:0}: Error finding container ccb46d3679181c3850abe45e19371d8c5ba7eafee30564dee334d7fa0afb2525: Status 404 returned error can't find the container with id ccb46d3679181c3850abe45e19371d8c5ba7eafee30564dee334d7fa0afb2525
Jul 23 16:27:17.974910 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:17.974883    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:27:18.579693 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:18.579652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2" event={"ID":"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e","Type":"ContainerStarted","Data":"ccb46d3679181c3850abe45e19371d8c5ba7eafee30564dee334d7fa0afb2525"}
Jul 23 16:27:19.436915 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:19.436883    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:27:19.585942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:19.585907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2" event={"ID":"62ef9974-f01f-4b9f-af91-9bcd2ab2d97e","Type":"ContainerStarted","Data":"2436ffc5037939843dddc2d51b2d6cc5cdf2b0a4a25e6b18aad706da50e6c107"}
Jul 23 16:27:19.611825 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:19.611772    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2" podStartSLOduration=1.5750750089999999 podStartE2EDuration="2.611754822s" totalImagesPullingTime="1.036679813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:27:19.610938257 +0000 UTC m=+693.016305553" watchObservedRunningTime="2026-07-23 16:27:19.611754822 +0000 UTC m=+693.017122080"
Jul 23 16:27:27.839507 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:27.839461    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:27.839940 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:27.839528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:27.852183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:27.852154    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:28.635259 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:28.635230    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2"
Jul 23 16:27:29.628701 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:29.628662    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:27:41.331763 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.331732    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"]
Jul 23 16:27:41.335055 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.335038    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.337737 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.337718    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 16:27:41.344521 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.344501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"]
Jul 23 16:27:41.486931 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.486897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.486931 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.486945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wq6\" (UniqueName: \"kubernetes.io/projected/51157fa4-1d20-4d67-9cdd-62a707080f8d-kube-api-access-x7wq6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.487201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.487063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.487201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.487102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.487201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.487155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51157fa4-1d20-4d67-9cdd-62a707080f8d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.487201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.487189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588028 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.587947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588028 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.587981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588028 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51157fa4-1d20-4d67-9cdd-62a707080f8d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588028 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588359 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588359 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wq6\" (UniqueName: \"kubernetes.io/projected/51157fa4-1d20-4d67-9cdd-62a707080f8d-kube-api-access-x7wq6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588468 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588528 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.588528 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.588516    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.590646 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.590615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51157fa4-1d20-4d67-9cdd-62a707080f8d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.590774 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.590719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51157fa4-1d20-4d67-9cdd-62a707080f8d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.596352 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.596327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wq6\" (UniqueName: \"kubernetes.io/projected/51157fa4-1d20-4d67-9cdd-62a707080f8d-kube-api-access-x7wq6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vl822\" (UID: \"51157fa4-1d20-4d67-9cdd-62a707080f8d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.645122 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.645074    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:41.772767 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:41.772739    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"]
Jul 23 16:27:41.774940 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:27:41.774912    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51157fa4_1d20_4d67_9cdd_62a707080f8d.slice/crio-54d7279a40560de8b1e2c753565760f3f56742452458e6206bcecde65326f3cd WatchSource:0}: Error finding container 54d7279a40560de8b1e2c753565760f3f56742452458e6206bcecde65326f3cd: Status 404 returned error can't find the container with id 54d7279a40560de8b1e2c753565760f3f56742452458e6206bcecde65326f3cd
Jul 23 16:27:42.689294 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:42.689255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822" event={"ID":"51157fa4-1d20-4d67-9cdd-62a707080f8d","Type":"ContainerStarted","Data":"58f777b42e31ff031f78989ae02d86fbf8eef63f8c8086860ee3a709432af89c"}
Jul 23 16:27:42.689294 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:42.689296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822" event={"ID":"51157fa4-1d20-4d67-9cdd-62a707080f8d","Type":"ContainerStarted","Data":"54d7279a40560de8b1e2c753565760f3f56742452458e6206bcecde65326f3cd"}
Jul 23 16:27:42.707229 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:42.707168    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822" podStartSLOduration=1.4766767170000001 podStartE2EDuration="1.70715215s" totalImagesPullingTime="230.475433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:27:42.706299625 +0000 UTC m=+716.111666895" watchObservedRunningTime="2026-07-23 16:27:42.70715215 +0000 UTC m=+716.112519407"
Jul 23 16:27:43.826475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:43.826443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:27:51.645998 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:51.645956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:51.646409 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:51.646037    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:51.658350 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:51.658323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:27:51.739790 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:27:51.739760    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vl822"
Jul 23 16:29:34.231420 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:29:34.231329    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:29:47.530237 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:29:47.530202    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:29:56.538076 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:29:56.538041    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:31:35.539451 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:31:35.539414    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:32:15.536926 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:32:15.536825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:32:23.332029 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:32:23.331990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:32:34.229779 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:32:34.229736    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:32:42.729656 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:32:42.729613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:32:53.932903 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:32:53.932859    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:33:02.941428 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:33:02.941391    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:33:14.429769 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:33:14.429731    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:33:24.337392 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:33:24.337354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:33:50.264599 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:33:50.264502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:34:00.328265 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:34:00.328229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:34:23.042968 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:34:23.042935    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:34:33.244620 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:34:33.244586    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:34:51.259543 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:34:51.259509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:35:00.451366 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:35:00.451329    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:35:10.845120 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:35:10.845038    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:35:20.654583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:35:20.654546    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:35:31.178442 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:35:31.178411    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:35:56.296169 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:35:56.296133    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"]
Jul 23 16:35:56.296740 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:35:56.296356    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk" podUID="94f3b196-7b71-4340-9a29-518e75b179e4" containerName="manager" containerID="cri-o://2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e" gracePeriod=10
Jul 23 16:36:00.355183 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.355158    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:36:00.475094 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.475001    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmbrt\" (UniqueName: \"kubernetes.io/projected/94f3b196-7b71-4340-9a29-518e75b179e4-kube-api-access-dmbrt\") pod \"94f3b196-7b71-4340-9a29-518e75b179e4\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") "
Jul 23 16:36:00.475272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.475098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f3b196-7b71-4340-9a29-518e75b179e4-extensions-socket-volume\") pod \"94f3b196-7b71-4340-9a29-518e75b179e4\" (UID: \"94f3b196-7b71-4340-9a29-518e75b179e4\") "
Jul 23 16:36:00.475447 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.475423    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f3b196-7b71-4340-9a29-518e75b179e4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94f3b196-7b71-4340-9a29-518e75b179e4" (UID: "94f3b196-7b71-4340-9a29-518e75b179e4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:00.477272 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.477250    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f3b196-7b71-4340-9a29-518e75b179e4-kube-api-access-dmbrt" (OuterVolumeSpecName: "kube-api-access-dmbrt") pod "94f3b196-7b71-4340-9a29-518e75b179e4" (UID: "94f3b196-7b71-4340-9a29-518e75b179e4"). InnerVolumeSpecName "kube-api-access-dmbrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:36:00.576021 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.575983    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f3b196-7b71-4340-9a29-518e75b179e4-extensions-socket-volume\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:36:00.576021 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:00.576019    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmbrt\" (UniqueName: \"kubernetes.io/projected/94f3b196-7b71-4340-9a29-518e75b179e4-kube-api-access-dmbrt\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:36:01.011451 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.011419    2582 generic.go:356] "Generic (PLEG): container finished" podID="94f3b196-7b71-4340-9a29-518e75b179e4" containerID="2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e" exitCode=0
Jul 23 16:36:01.011630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.011465    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"
Jul 23 16:36:01.011630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.011477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk" event={"ID":"94f3b196-7b71-4340-9a29-518e75b179e4","Type":"ContainerDied","Data":"2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e"}
Jul 23 16:36:01.011630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.011520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk" event={"ID":"94f3b196-7b71-4340-9a29-518e75b179e4","Type":"ContainerDied","Data":"ed505cbd462b52edbe5b0f9bcc275a399043d9714ed1d29dae4e7653d9c90667"}
Jul 23 16:36:01.011630 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.011540    2582 scope.go:117] "RemoveContainer" containerID="2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e"
Jul 23 16:36:01.021619 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.021599    2582 scope.go:117] "RemoveContainer" containerID="2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e"
Jul 23 16:36:01.021893 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:36:01.021873    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e\": container with ID starting with 2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e not found: ID does not exist" containerID="2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e"
Jul 23 16:36:01.021973 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.021902    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e"} err="failed to get container status \"2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e\": rpc error: code = NotFound desc = could not find container \"2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e\": container with ID starting with 2d9674a02e265a905aa30bbadf1bcb02a53d402ca82a226b63dfbc7df630f40e not found: ID does not exist"
Jul 23 16:36:01.033201 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.033177    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"]
Jul 23 16:36:01.036832 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.036810    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m5rzk"]
Jul 23 16:36:01.592594 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:01.592560    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f3b196-7b71-4340-9a29-518e75b179e4" path="/var/lib/kubelet/pods/94f3b196-7b71-4340-9a29-518e75b179e4/volumes"
Jul 23 16:36:57.518765 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.518727    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"]
Jul 23 16:36:57.519210 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.519131    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f3b196-7b71-4340-9a29-518e75b179e4" containerName="manager"
Jul 23 16:36:57.519210 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.519145    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f3b196-7b71-4340-9a29-518e75b179e4" containerName="manager"
Jul 23 16:36:57.519210 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.519210    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f3b196-7b71-4340-9a29-518e75b179e4" containerName="manager"
Jul 23 16:36:57.523575 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.523558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.526393 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.526370    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7w4z4\""
Jul 23 16:36:57.534027 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.534001    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"]
Jul 23 16:36:57.598172 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.598137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtcks\" (UniqueName: \"kubernetes.io/projected/b41cb8e0-4ca1-4244-b482-ae8e01454557-kube-api-access-jtcks\") pod \"kuadrant-operator-controller-manager-86878c769f-zfkdk\" (UID: \"b41cb8e0-4ca1-4244-b482-ae8e01454557\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.598370 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.598188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b41cb8e0-4ca1-4244-b482-ae8e01454557-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfkdk\" (UID: \"b41cb8e0-4ca1-4244-b482-ae8e01454557\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.698887 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.698815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtcks\" (UniqueName: \"kubernetes.io/projected/b41cb8e0-4ca1-4244-b482-ae8e01454557-kube-api-access-jtcks\") pod \"kuadrant-operator-controller-manager-86878c769f-zfkdk\" (UID: \"b41cb8e0-4ca1-4244-b482-ae8e01454557\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.698887 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.698888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b41cb8e0-4ca1-4244-b482-ae8e01454557-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfkdk\" (UID: \"b41cb8e0-4ca1-4244-b482-ae8e01454557\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.699227 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.699211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b41cb8e0-4ca1-4244-b482-ae8e01454557-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfkdk\" (UID: \"b41cb8e0-4ca1-4244-b482-ae8e01454557\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.711130 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.711091    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtcks\" (UniqueName: \"kubernetes.io/projected/b41cb8e0-4ca1-4244-b482-ae8e01454557-kube-api-access-jtcks\") pod \"kuadrant-operator-controller-manager-86878c769f-zfkdk\" (UID: \"b41cb8e0-4ca1-4244-b482-ae8e01454557\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.834292 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.834188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:57.978721 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:57.978695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"]
Jul 23 16:36:57.981467 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:36:57.981440    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41cb8e0_4ca1_4244_b482_ae8e01454557.slice/crio-790d2f5536613abcb44c69a5301c9834d467261945e2213c0712bd2f0949b7b7 WatchSource:0}: Error finding container 790d2f5536613abcb44c69a5301c9834d467261945e2213c0712bd2f0949b7b7: Status 404 returned error can't find the container with id 790d2f5536613abcb44c69a5301c9834d467261945e2213c0712bd2f0949b7b7
Jul 23 16:36:58.274441 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:58.274395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk" event={"ID":"b41cb8e0-4ca1-4244-b482-ae8e01454557","Type":"ContainerStarted","Data":"ab6a75ec6e565bde14ebd67e1f3c275847625b9f65aa584eb637df886c9678c5"}
Jul 23 16:36:58.274633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:58.274467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk" event={"ID":"b41cb8e0-4ca1-4244-b482-ae8e01454557","Type":"ContainerStarted","Data":"790d2f5536613abcb44c69a5301c9834d467261945e2213c0712bd2f0949b7b7"}
Jul 23 16:36:58.274633 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:58.274496    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:36:58.295375 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:36:58.295131    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk" podStartSLOduration=1.295110545 podStartE2EDuration="1.295110545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:36:58.294002224 +0000 UTC m=+1271.699369494" watchObservedRunningTime="2026-07-23 16:36:58.295110545 +0000 UTC m=+1271.700477815"
Jul 23 16:37:09.282606 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:37:09.282573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfkdk"
Jul 23 16:37:17.459880 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:37:17.459829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:37:29.437027 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:37:29.436991    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:37:37.434560 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:37:37.434520    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:37:48.227652 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:37:48.227611    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:37:58.633669 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:37:58.633632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:38:09.446469 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:38:09.446387    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:38:18.636324 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:38:18.636281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:38:29.628354 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:38:29.628314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:38:42.026376 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:38:42.026337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:38:50.233854 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:38:50.233805    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:39:02.529862 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:02.529794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:39:24.433251 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:24.433216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:39:33.537277 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:33.537240    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:39:37.042452 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.042412    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"]
Jul 23 16:39:37.045804 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.045789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.048271 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.048251    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4afbf09d-kserve-self-signed-certs\""
Jul 23 16:39:37.064343 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.064318    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"]
Jul 23 16:39:37.152188 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.152139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tls-certs\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.152371 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.152205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-dshm\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.152371 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.152227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tmp-dir\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.152371 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.152263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-home\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.152371 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.152298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjh9x\" (UniqueName: \"kubernetes.io/projected/8434e6f0-11a0-4987-9691-c0b7d1d94e48-kube-api-access-cjh9x\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.152371 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.152335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-model-cache\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.253654 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.253609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tls-certs\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.253654 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.253657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-dshm\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.253935 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.253683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tmp-dir\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.253935 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.253714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-home\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.253935 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.253740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjh9x\" (UniqueName: \"kubernetes.io/projected/8434e6f0-11a0-4987-9691-c0b7d1d94e48-kube-api-access-cjh9x\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.253935 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.253770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-model-cache\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.254179 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.254159    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-model-cache\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.254229 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.254195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tmp-dir\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.254229 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.254210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-home\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.256429 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.256412    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-dshm\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.256695 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.256678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tls-certs\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.261925 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.261904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjh9x\" (UniqueName: \"kubernetes.io/projected/8434e6f0-11a0-4987-9691-c0b7d1d94e48-kube-api-access-cjh9x\") pod \"e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") " pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.354585 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.354498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:37.491023 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:37.490999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"]
Jul 23 16:39:37.492797 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:39:37.492756    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8434e6f0_11a0_4987_9691_c0b7d1d94e48.slice/crio-acaaa44549521d861f8bdd94a5eb0d13c10bd8f26b1330d1e559545331f67c27 WatchSource:0}: Error finding container acaaa44549521d861f8bdd94a5eb0d13c10bd8f26b1330d1e559545331f67c27: Status 404 returned error can't find the container with id acaaa44549521d861f8bdd94a5eb0d13c10bd8f26b1330d1e559545331f67c27
Jul 23 16:39:38.045530 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:38.045492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d" event={"ID":"8434e6f0-11a0-4987-9691-c0b7d1d94e48","Type":"ContainerStarted","Data":"b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda"}
Jul 23 16:39:38.045948 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:38.045540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d" event={"ID":"8434e6f0-11a0-4987-9691-c0b7d1d94e48","Type":"ContainerStarted","Data":"acaaa44549521d861f8bdd94a5eb0d13c10bd8f26b1330d1e559545331f67c27"}
Jul 23 16:39:38.065931 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:38.065880    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d" podStartSLOduration=1.065862854 podStartE2EDuration="1.065862854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:39:38.064498075 +0000 UTC m=+1431.469865334" watchObservedRunningTime="2026-07-23 16:39:38.065862854 +0000 UTC m=+1431.471230106"
Jul 23 16:39:47.355638 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:47.355542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:47.355638 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:47.355600    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:47.374123 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:47.374092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:39:47.729868 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:47.729822    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:39:48.106501 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:39:48.106411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:40:38.948934 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:38.948894    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"]
Jul 23 16:40:41.926123 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:41.926085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:40:52.826048 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:52.826007    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:40:53.970471 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:53.970432    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d" podUID="8434e6f0-11a0-4987-9691-c0b7d1d94e48" containerName="main" containerID="cri-o://b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda" gracePeriod=45
Jul 23 16:40:54.227875 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.227795    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:40:54.267050 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267009    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tmp-dir\") pod \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") "
Jul 23 16:40:54.267243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267063    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-dshm\") pod \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") "
Jul 23 16:40:54.267243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267090    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-model-cache\") pod \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") "
Jul 23 16:40:54.267243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-home\") pod \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") "
Jul 23 16:40:54.267243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjh9x\" (UniqueName: \"kubernetes.io/projected/8434e6f0-11a0-4987-9691-c0b7d1d94e48-kube-api-access-cjh9x\") pod \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") "
Jul 23 16:40:54.267243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tls-certs\") pod \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\" (UID: \"8434e6f0-11a0-4987-9691-c0b7d1d94e48\") "
Jul 23 16:40:54.267569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8434e6f0-11a0-4987-9691-c0b7d1d94e48" (UID: "8434e6f0-11a0-4987-9691-c0b7d1d94e48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:54.267569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267336    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-model-cache" (OuterVolumeSpecName: "model-cache") pod "8434e6f0-11a0-4987-9691-c0b7d1d94e48" (UID: "8434e6f0-11a0-4987-9691-c0b7d1d94e48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:54.267569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267355    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-home" (OuterVolumeSpecName: "home") pod "8434e6f0-11a0-4987-9691-c0b7d1d94e48" (UID: "8434e6f0-11a0-4987-9691-c0b7d1d94e48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:54.267569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267557    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:40:54.267749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267578    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:40:54.267749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.267591    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:40:54.269478 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.269450    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-dshm" (OuterVolumeSpecName: "dshm") pod "8434e6f0-11a0-4987-9691-c0b7d1d94e48" (UID: "8434e6f0-11a0-4987-9691-c0b7d1d94e48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:54.269749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.269720    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8434e6f0-11a0-4987-9691-c0b7d1d94e48-kube-api-access-cjh9x" (OuterVolumeSpecName: "kube-api-access-cjh9x") pod "8434e6f0-11a0-4987-9691-c0b7d1d94e48" (UID: "8434e6f0-11a0-4987-9691-c0b7d1d94e48"). InnerVolumeSpecName "kube-api-access-cjh9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:40:54.269749 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.269742    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8434e6f0-11a0-4987-9691-c0b7d1d94e48" (UID: "8434e6f0-11a0-4987-9691-c0b7d1d94e48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:40:54.368711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.368667    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8434e6f0-11a0-4987-9691-c0b7d1d94e48-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:40:54.368711 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.368699    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjh9x\" (UniqueName: \"kubernetes.io/projected/8434e6f0-11a0-4987-9691-c0b7d1d94e48-kube-api-access-cjh9x\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:40:54.368960 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.368727    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8434e6f0-11a0-4987-9691-c0b7d1d94e48-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:40:54.427312 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.427282    2582 generic.go:356] "Generic (PLEG): container finished" podID="8434e6f0-11a0-4987-9691-c0b7d1d94e48" containerID="b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda" exitCode=0
Jul 23 16:40:54.427488 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.427325    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"
Jul 23 16:40:54.427488 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.427329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d" event={"ID":"8434e6f0-11a0-4987-9691-c0b7d1d94e48","Type":"ContainerDied","Data":"b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda"}
Jul 23 16:40:54.427488 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.427359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d" event={"ID":"8434e6f0-11a0-4987-9691-c0b7d1d94e48","Type":"ContainerDied","Data":"acaaa44549521d861f8bdd94a5eb0d13c10bd8f26b1330d1e559545331f67c27"}
Jul 23 16:40:54.427488 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.427377    2582 scope.go:117] "RemoveContainer" containerID="b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda"
Jul 23 16:40:54.436549 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.436531    2582 scope.go:117] "RemoveContainer" containerID="b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda"
Jul 23 16:40:54.436859 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:40:54.436832    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda\": container with ID starting with b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda not found: ID does not exist" containerID="b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda"
Jul 23 16:40:54.436930 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.436873    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda"} err="failed to get container status \"b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda\": rpc error: code = NotFound desc = could not find container \"b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda\": container with ID starting with b452ca867fa4c2ebfecc768775544851ef9f74b291d2c683b6e99119ed58dbda not found: ID does not exist"
Jul 23 16:40:54.447956 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.447925    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"]
Jul 23 16:40:54.451629 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:54.451604    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4afbf09d-kserve-6f9d569fbc-89z2d"]
Jul 23 16:40:55.593251 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:40:55.593215    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8434e6f0-11a0-4987-9691-c0b7d1d94e48" path="/var/lib/kubelet/pods/8434e6f0-11a0-4987-9691-c0b7d1d94e48/volumes"
Jul 23 16:41:02.230985 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:41:02.230947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:41:14.230320 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:41:14.230233    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:41:23.535792 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:41:23.535747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:41:33.344884 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:41:33.344825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:41:41.832060 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:41:41.832016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:41:52.536748 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:41:52.536705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:42:02.527083 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:42:02.527047    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:42:13.226547 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:42:13.226507    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:42:25.231107 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:42:25.231070    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:42:34.535542 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:42:34.535507    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:42:44.231329 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:42:44.231249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:42:57.436699 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:42:57.436653    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:43:06.632946 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:43:06.632909    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:43:18.637641 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:43:18.637611    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:43:31.252323 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:43:31.252283    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:43:44.532738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:43:44.532704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:43:58.850741 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:43:58.850704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:44:08.722925 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:44:08.722826    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:44:25.130003 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:44:25.129971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:45:00.943918 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:45:00.943880    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:45:11.741569 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:45:11.741532    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:45:44.629499 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:45:44.629470    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:45:56.144317 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:45:56.144283    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:46:28.726880 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:46:28.726831    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:46:39.735797 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:46:39.735758    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:47:12.723785 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:47:12.723702    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:48:40.951090 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:48:40.951011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:48:51.039841 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:48:51.039804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:49:04.036059 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:49:04.036022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:49:23.141874 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:49:23.141807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:50:02.931942 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:02.931909    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:50:04.419124 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.419088    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"]
Jul 23 16:50:04.419512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.419451    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8434e6f0-11a0-4987-9691-c0b7d1d94e48" containerName="main"
Jul 23 16:50:04.419512 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.419462    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8434e6f0-11a0-4987-9691-c0b7d1d94e48" containerName="main"
Jul 23 16:50:04.419583 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.419533    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8434e6f0-11a0-4987-9691-c0b7d1d94e48" containerName="main"
Jul 23 16:50:04.422702 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.422682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.425265 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.425241    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4fef36f3\"/\"openshift-service-ca.crt\""
Jul 23 16:50:04.426332 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.426310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4fef36f3\"/\"e2e-lifecycle-model-4fef36f3-kserve-self-signed-certs\""
Jul 23 16:50:04.426468 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.426363    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4fef36f3\"/\"default-dockercfg-hczvv\""
Jul 23 16:50:04.426468 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.426443    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4fef36f3\"/\"kube-root-ca.crt\""
Jul 23 16:50:04.433458 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.433436    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"]
Jul 23 16:50:04.586383 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.586346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-model-cache\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.586577 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.586408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-home\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.586577 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.586437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tmp-dir\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.586577 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.586460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tls-certs\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.586577 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.586501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-dshm\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.586743 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.586587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9rrw\" (UniqueName: \"kubernetes.io/projected/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-kube-api-access-q9rrw\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.687687 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.687605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tls-certs\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.687687 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.687649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-dshm\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.687889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.687785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9rrw\" (UniqueName: \"kubernetes.io/projected/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-kube-api-access-q9rrw\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.687940 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.687907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-model-cache\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.687981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.687936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-home\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.687981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.687959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tmp-dir\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.688277 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.688245    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-model-cache\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.688400 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.688295    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-home\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.688400 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.688322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tmp-dir\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.690425 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.690396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-dshm\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.690800 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.690778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tls-certs\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.696365 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.696342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9rrw\" (UniqueName: \"kubernetes.io/projected/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-kube-api-access-q9rrw\") pod \"e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") " pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.732215 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.732184    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:04.864555 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:04.864530    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"]
Jul 23 16:50:04.866374 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:50:04.866349    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4eb8968_a842_4fb6_9b2b_ecafd2b4fff7.slice/crio-7bacfab6b8253140404136f490ddd1aedd7d3eadb296bfce08dffa3e1d2e00c2 WatchSource:0}: Error finding container 7bacfab6b8253140404136f490ddd1aedd7d3eadb296bfce08dffa3e1d2e00c2: Status 404 returned error can't find the container with id 7bacfab6b8253140404136f490ddd1aedd7d3eadb296bfce08dffa3e1d2e00c2
Jul 23 16:50:05.002944 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:05.002820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9" event={"ID":"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7","Type":"ContainerStarted","Data":"fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7"}
Jul 23 16:50:05.002944 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:05.002899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9" event={"ID":"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7","Type":"ContainerStarted","Data":"7bacfab6b8253140404136f490ddd1aedd7d3eadb296bfce08dffa3e1d2e00c2"}
Jul 23 16:50:05.021729 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:05.021676    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9" podStartSLOduration=1.021660427 podStartE2EDuration="1.021660427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:50:05.020399422 +0000 UTC m=+2058.425766683" watchObservedRunningTime="2026-07-23 16:50:05.021660427 +0000 UTC m=+2058.427027740"
Jul 23 16:50:14.732479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:14.732380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:14.732479 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:14.732477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:14.744923 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:14.744893    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:15.060464 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:15.060383    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:50:15.437213 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:15.437176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:50:26.739335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:26.739298    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:50:39.839924 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:39.839888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:50:48.752622 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:48.752570    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:50:51.702741 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:50:51.702705    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"]
Jul 23 16:51:06.722702 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:06.722642    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9" podUID="b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" containerName="main" containerID="cri-o://fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7" gracePeriod=45
Jul 23 16:51:06.983172 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:06.983104    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:51:07.050723 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.050689    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-model-cache\") pod \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") "
Jul 23 16:51:07.050723 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.050728    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-home\") pod \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") "
Jul 23 16:51:07.051036 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.050775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tls-certs\") pod \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") "
Jul 23 16:51:07.051036 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.050891    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-dshm\") pod \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") "
Jul 23 16:51:07.051036 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.050918    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9rrw\" (UniqueName: \"kubernetes.io/projected/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-kube-api-access-q9rrw\") pod \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") "
Jul 23 16:51:07.051036 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.050955    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tmp-dir\") pod \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\" (UID: \"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7\") "
Jul 23 16:51:07.051238 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.051033    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-model-cache" (OuterVolumeSpecName: "model-cache") pod "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" (UID: "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:07.051238 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.051107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-home" (OuterVolumeSpecName: "home") pod "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" (UID: "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:07.051337 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.051262    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" (UID: "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:07.051337 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.051282    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:51:07.051337 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.051302    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:51:07.053143 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.053120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-dshm" (OuterVolumeSpecName: "dshm") pod "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" (UID: "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:07.053143 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.053131    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-kube-api-access-q9rrw" (OuterVolumeSpecName: "kube-api-access-q9rrw") pod "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" (UID: "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7"). InnerVolumeSpecName "kube-api-access-q9rrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:51:07.053282 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.053216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" (UID: "b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:51:07.151899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.151841    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:51:07.151899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.151888    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:51:07.151899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.151899    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9rrw\" (UniqueName: \"kubernetes.io/projected/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-kube-api-access-q9rrw\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:51:07.151899 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.151908    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:51:07.287910 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.287812    2582 generic.go:356] "Generic (PLEG): container finished" podID="b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" containerID="fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7" exitCode=0
Jul 23 16:51:07.287910 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.287884    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"
Jul 23 16:51:07.288129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.287882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9" event={"ID":"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7","Type":"ContainerDied","Data":"fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7"}
Jul 23 16:51:07.288129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.287993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9" event={"ID":"b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7","Type":"ContainerDied","Data":"7bacfab6b8253140404136f490ddd1aedd7d3eadb296bfce08dffa3e1d2e00c2"}
Jul 23 16:51:07.288129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.288013    2582 scope.go:117] "RemoveContainer" containerID="fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7"
Jul 23 16:51:07.297369 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.297353    2582 scope.go:117] "RemoveContainer" containerID="fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7"
Jul 23 16:51:07.297623 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:51:07.297601    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7\": container with ID starting with fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7 not found: ID does not exist" containerID="fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7"
Jul 23 16:51:07.297663 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.297633    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7"} err="failed to get container status \"fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7\": rpc error: code = NotFound desc = could not find container \"fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7\": container with ID starting with fcd781d4c82cfc429f1dd00dd5a675b1b7833201db684b03d0c2a987ee9915c7 not found: ID does not exist"
Jul 23 16:51:07.314323 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.314295    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"]
Jul 23 16:51:07.320020 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.319997    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4fef36f3/e2e-lifecycle-model-4fef36f3-kserve-5f6d7dc775-rskg9"]
Jul 23 16:51:07.593194 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:07.593108    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" path="/var/lib/kubelet/pods/b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7/volumes"
Jul 23 16:51:38.729678 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:38.729594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:51:48.539096 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:51:48.539061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:52:40.532820 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:52:40.532783    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:52:52.939626 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:52:52.939591    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:53:03.435297 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.435265    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"]
Jul 23 16:53:03.435806 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.435665    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" containerName="main"
Jul 23 16:53:03.435806 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.435680    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" containerName="main"
Jul 23 16:53:03.435806 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.435775    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4eb8968-a842-4fb6-9b2b-ecafd2b4fff7" containerName="main"
Jul 23 16:53:03.439017 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.438993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.442594 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.442564    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-546d5f\"/\"kube-root-ca.crt\""
Jul 23 16:53:03.442594 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.442566    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-546d5f\"/\"openshift-service-ca.crt\""
Jul 23 16:53:03.442789 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.442592    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-546d5f\"/\"default-dockercfg-v24dk\""
Jul 23 16:53:03.442789 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.442637    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-546d5f\"/\"test-model-546d5f-kserve-self-signed-certs\""
Jul 23 16:53:03.448526 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.448503    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"]
Jul 23 16:53:03.520114 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.520077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crz2p\" (UniqueName: \"kubernetes.io/projected/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-kube-api-access-crz2p\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.520297 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.520146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-model-cache\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.520297 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.520237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-home\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.520297 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.520282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tls-certs\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.520403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.520301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-dshm\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.520403 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.520368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tmp-dir\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621250 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-dshm\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tmp-dir\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crz2p\" (UniqueName: \"kubernetes.io/projected/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-kube-api-access-crz2p\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-model-cache\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-home\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621431 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tls-certs\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621765 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tmp-dir\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621765 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-model-cache\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.621919 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.621786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-home\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.623422 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.623400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-dshm\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.623780 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.623760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tls-certs\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.629598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.629568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crz2p\" (UniqueName: \"kubernetes.io/projected/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-kube-api-access-crz2p\") pod \"test-model-546d5f-kserve-5564bf4b7c-qcpr2\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") " pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.750047 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.749951    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:03.889233 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:03.889209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"]
Jul 23 16:53:03.891691 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:53:03.891663    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd22ec902_5a76_46bf_bbc5_6d8a6b038f0b.slice/crio-4e370e49ef21fa27ccc96f0e673d4a62d4ca1a5c14ae63ec55d0a17a9b49e62f WatchSource:0}: Error finding container 4e370e49ef21fa27ccc96f0e673d4a62d4ca1a5c14ae63ec55d0a17a9b49e62f: Status 404 returned error can't find the container with id 4e370e49ef21fa27ccc96f0e673d4a62d4ca1a5c14ae63ec55d0a17a9b49e62f
Jul 23 16:53:04.837278 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:04.837240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2" event={"ID":"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b","Type":"ContainerStarted","Data":"097303be636e29c4ee170444a375fd0435e7a40e94582f60a81da60e0560ce17"}
Jul 23 16:53:04.837689 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:04.837289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2" event={"ID":"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b","Type":"ContainerStarted","Data":"4e370e49ef21fa27ccc96f0e673d4a62d4ca1a5c14ae63ec55d0a17a9b49e62f"}
Jul 23 16:53:04.855674 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:04.855622    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2" podStartSLOduration=1.855605593 podStartE2EDuration="1.855605593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:04.853533899 +0000 UTC m=+2238.258901160" watchObservedRunningTime="2026-07-23 16:53:04.855605593 +0000 UTC m=+2238.260972851"
Jul 23 16:53:06.829736 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:06.829701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:53:13.750374 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:13.750281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:13.750374 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:13.750333    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:13.763130 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:13.763100    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:13.895796 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:13.895768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:53:18.132862 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:18.132805    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:53:29.151734 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.151680    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"]
Jul 23 16:53:29.157306 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.157269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.161947 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.161756    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-16a998\"/\"openshift-service-ca.crt\""
Jul 23 16:53:29.161947 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.161807    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-16a998\"/\"test-model-16a998-kserve-self-signed-certs\""
Jul 23 16:53:29.161947 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.161898    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-16a998\"/\"default-dockercfg-b6wlw\""
Jul 23 16:53:29.162237 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.162224    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-16a998\"/\"kube-root-ca.crt\""
Jul 23 16:53:29.163980 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.163960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"]
Jul 23 16:53:29.251496 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.251461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-tmp-dir\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.251691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.251506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-model-cache\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.251691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.251528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dff5399-efc4-4e8f-8554-1efa741f7af9-tls-certs\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.251691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.251620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-dshm\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.251691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.251657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmfkj\" (UniqueName: \"kubernetes.io/projected/9dff5399-efc4-4e8f-8554-1efa741f7af9-kube-api-access-gmfkj\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.251893 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.251725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-home\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352341 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-dshm\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352341 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmfkj\" (UniqueName: \"kubernetes.io/projected/9dff5399-efc4-4e8f-8554-1efa741f7af9-kube-api-access-gmfkj\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352587 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-home\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352587 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-tmp-dir\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352587 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-model-cache\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352587 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dff5399-efc4-4e8f-8554-1efa741f7af9-tls-certs\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.352884 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-tmp-dir\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.353008 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-home\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.353008 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.352943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-model-cache\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.354787 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.354762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-dshm\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.355004 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.354989    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dff5399-efc4-4e8f-8554-1efa741f7af9-tls-certs\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.362285 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.362251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmfkj\" (UniqueName: \"kubernetes.io/projected/9dff5399-efc4-4e8f-8554-1efa741f7af9-kube-api-access-gmfkj\") pod \"test-model-16a998-kserve-5b88c5955c-hb8tj\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") " pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.468052 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.467960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:29.605826 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.605797    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"]
Jul 23 16:53:29.607624 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:53:29.607594    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dff5399_efc4_4e8f_8554_1efa741f7af9.slice/crio-217c4eb50c231b75184be23e2c3a82cd32b35a01f0a8e5fc9dd928f9526e2e55 WatchSource:0}: Error finding container 217c4eb50c231b75184be23e2c3a82cd32b35a01f0a8e5fc9dd928f9526e2e55: Status 404 returned error can't find the container with id 217c4eb50c231b75184be23e2c3a82cd32b35a01f0a8e5fc9dd928f9526e2e55
Jul 23 16:53:29.960941 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.960902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj" event={"ID":"9dff5399-efc4-4e8f-8554-1efa741f7af9","Type":"ContainerStarted","Data":"30013eebcdab189ab66c776a722a68222a0cc03bec50f2941d36f5d0c1c08548"}
Jul 23 16:53:29.960941 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.960946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj" event={"ID":"9dff5399-efc4-4e8f-8554-1efa741f7af9","Type":"ContainerStarted","Data":"217c4eb50c231b75184be23e2c3a82cd32b35a01f0a8e5fc9dd928f9526e2e55"}
Jul 23 16:53:29.981947 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:29.981874    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj" podStartSLOduration=0.981836843 podStartE2EDuration="981.836843ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:29.979424759 +0000 UTC m=+2263.384792020" watchObservedRunningTime="2026-07-23 16:53:29.981836843 +0000 UTC m=+2263.387204102"
Jul 23 16:53:34.728556 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:34.728513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:53:39.468882 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:39.468809    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:39.469296 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:39.468898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:39.484057 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:39.484024    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:53:40.019920 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:53:40.019888    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:54:28.128184 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:28.128135    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"]
Jul 23 16:54:29.061976 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:29.061939    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"]
Jul 23 16:54:33.629527 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:33.629487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:54:43.148801 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.148700    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2" podUID="d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" containerName="main" containerID="cri-o://097303be636e29c4ee170444a375fd0435e7a40e94582f60a81da60e0560ce17" gracePeriod=45
Jul 23 16:54:43.315491 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.315452    2582 generic.go:356] "Generic (PLEG): container finished" podID="d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" containerID="097303be636e29c4ee170444a375fd0435e7a40e94582f60a81da60e0560ce17" exitCode=0
Jul 23 16:54:43.315491 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.315477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2" event={"ID":"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b","Type":"ContainerDied","Data":"097303be636e29c4ee170444a375fd0435e7a40e94582f60a81da60e0560ce17"}
Jul 23 16:54:43.403840 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.403791    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:54:43.453524 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453500    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crz2p\" (UniqueName: \"kubernetes.io/projected/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-kube-api-access-crz2p\") pod \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") "
Jul 23 16:54:43.453685 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453535    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-model-cache\") pod \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") "
Jul 23 16:54:43.453685 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453556    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-home\") pod \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") "
Jul 23 16:54:43.453685 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453572    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tls-certs\") pod \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") "
Jul 23 16:54:43.453685 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tmp-dir\") pod \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") "
Jul 23 16:54:43.453685 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453658    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-dshm\") pod \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\" (UID: \"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b\") "
Jul 23 16:54:43.453988 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453841    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-model-cache" (OuterVolumeSpecName: "model-cache") pod "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" (UID: "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:43.453988 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453872    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-home" (OuterVolumeSpecName: "home") pod "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" (UID: "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:43.454064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.453979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" (UID: "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:43.454064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.454022    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:43.454064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.454035    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:43.455898 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.455873    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-dshm" (OuterVolumeSpecName: "dshm") pod "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" (UID: "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:43.455993 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.455874    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" (UID: "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:54:43.455993 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.455969    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-kube-api-access-crz2p" (OuterVolumeSpecName: "kube-api-access-crz2p") pod "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" (UID: "d22ec902-5a76-46bf-bbc5-6d8a6b038f0b"). InnerVolumeSpecName "kube-api-access-crz2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:54:43.554842 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.554807    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:43.554842 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.554835    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:43.554842 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.554869    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crz2p\" (UniqueName: \"kubernetes.io/projected/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-kube-api-access-crz2p\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:43.555074 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:43.554878    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:44.089281 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.089238    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj" podUID="9dff5399-efc4-4e8f-8554-1efa741f7af9" containerName="main" containerID="cri-o://30013eebcdab189ab66c776a722a68222a0cc03bec50f2941d36f5d0c1c08548" gracePeriod=45
Jul 23 16:54:44.322210 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.322176    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"
Jul 23 16:54:44.322210 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.322188    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2" event={"ID":"d22ec902-5a76-46bf-bbc5-6d8a6b038f0b","Type":"ContainerDied","Data":"4e370e49ef21fa27ccc96f0e673d4a62d4ca1a5c14ae63ec55d0a17a9b49e62f"}
Jul 23 16:54:44.322692 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.322242    2582 scope.go:117] "RemoveContainer" containerID="097303be636e29c4ee170444a375fd0435e7a40e94582f60a81da60e0560ce17"
Jul 23 16:54:44.323987 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.323966    2582 generic.go:356] "Generic (PLEG): container finished" podID="9dff5399-efc4-4e8f-8554-1efa741f7af9" containerID="30013eebcdab189ab66c776a722a68222a0cc03bec50f2941d36f5d0c1c08548" exitCode=0
Jul 23 16:54:44.324123 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.324042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj" event={"ID":"9dff5399-efc4-4e8f-8554-1efa741f7af9","Type":"ContainerDied","Data":"30013eebcdab189ab66c776a722a68222a0cc03bec50f2941d36f5d0c1c08548"}
Jul 23 16:54:44.339190 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.339110    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"]
Jul 23 16:54:44.340940 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.340919    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-546d5f/test-model-546d5f-kserve-5564bf4b7c-qcpr2"]
Jul 23 16:54:44.356087 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.356067    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:54:44.362508 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362493    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmfkj\" (UniqueName: \"kubernetes.io/projected/9dff5399-efc4-4e8f-8554-1efa741f7af9-kube-api-access-gmfkj\") pod \"9dff5399-efc4-4e8f-8554-1efa741f7af9\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") "
Jul 23 16:54:44.362566 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362520    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-tmp-dir\") pod \"9dff5399-efc4-4e8f-8554-1efa741f7af9\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") "
Jul 23 16:54:44.362566 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362538    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-home\") pod \"9dff5399-efc4-4e8f-8554-1efa741f7af9\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") "
Jul 23 16:54:44.362692 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362676    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dff5399-efc4-4e8f-8554-1efa741f7af9-tls-certs\") pod \"9dff5399-efc4-4e8f-8554-1efa741f7af9\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") "
Jul 23 16:54:44.362731 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-model-cache\") pod \"9dff5399-efc4-4e8f-8554-1efa741f7af9\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") "
Jul 23 16:54:44.362788 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362765    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9dff5399-efc4-4e8f-8554-1efa741f7af9" (UID: "9dff5399-efc4-4e8f-8554-1efa741f7af9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:44.362831 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362780    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-home" (OuterVolumeSpecName: "home") pod "9dff5399-efc4-4e8f-8554-1efa741f7af9" (UID: "9dff5399-efc4-4e8f-8554-1efa741f7af9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:44.362831 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-dshm\") pod \"9dff5399-efc4-4e8f-8554-1efa741f7af9\" (UID: \"9dff5399-efc4-4e8f-8554-1efa741f7af9\") "
Jul 23 16:54:44.362978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.362957    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-model-cache" (OuterVolumeSpecName: "model-cache") pod "9dff5399-efc4-4e8f-8554-1efa741f7af9" (UID: "9dff5399-efc4-4e8f-8554-1efa741f7af9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:44.363129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.363108    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:44.363129 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.363127    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:44.363249 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.363136    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:44.364697 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.364664    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dff5399-efc4-4e8f-8554-1efa741f7af9-kube-api-access-gmfkj" (OuterVolumeSpecName: "kube-api-access-gmfkj") pod "9dff5399-efc4-4e8f-8554-1efa741f7af9" (UID: "9dff5399-efc4-4e8f-8554-1efa741f7af9"). InnerVolumeSpecName "kube-api-access-gmfkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:54:44.364697 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.364690    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dff5399-efc4-4e8f-8554-1efa741f7af9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9dff5399-efc4-4e8f-8554-1efa741f7af9" (UID: "9dff5399-efc4-4e8f-8554-1efa741f7af9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:54:44.364834 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.364689    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-dshm" (OuterVolumeSpecName: "dshm") pod "9dff5399-efc4-4e8f-8554-1efa741f7af9" (UID: "9dff5399-efc4-4e8f-8554-1efa741f7af9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:44.464283 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.464248    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dff5399-efc4-4e8f-8554-1efa741f7af9-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:44.464283 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.464273    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmfkj\" (UniqueName: \"kubernetes.io/projected/9dff5399-efc4-4e8f-8554-1efa741f7af9-kube-api-access-gmfkj\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:44.464283 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:44.464284    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dff5399-efc4-4e8f-8554-1efa741f7af9-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:54:45.330175 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.330145    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"
Jul 23 16:54:45.330612 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.330187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj" event={"ID":"9dff5399-efc4-4e8f-8554-1efa741f7af9","Type":"ContainerDied","Data":"217c4eb50c231b75184be23e2c3a82cd32b35a01f0a8e5fc9dd928f9526e2e55"}
Jul 23 16:54:45.330612 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.330238    2582 scope.go:117] "RemoveContainer" containerID="30013eebcdab189ab66c776a722a68222a0cc03bec50f2941d36f5d0c1c08548"
Jul 23 16:54:45.351919 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.351894    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"]
Jul 23 16:54:45.355992 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.355972    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-16a998/test-model-16a998-kserve-5b88c5955c-hb8tj"]
Jul 23 16:54:45.593541 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.593465    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dff5399-efc4-4e8f-8554-1efa741f7af9" path="/var/lib/kubelet/pods/9dff5399-efc4-4e8f-8554-1efa741f7af9/volumes"
Jul 23 16:54:45.593919 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:45.593903    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" path="/var/lib/kubelet/pods/d22ec902-5a76-46bf-bbc5-6d8a6b038f0b/volumes"
Jul 23 16:54:48.628830 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:54:48.628800    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:55:04.539792 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:55:04.539754    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:55:26.195857 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:55:26.195806    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:55:38.544380 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:55:38.544350    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:55:56.136333 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:55:56.136295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:56:25.427585 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:56:25.427501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:56:39.734616 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:56:39.734581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:56:54.227517 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:56:54.227468    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:57:03.628736 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.628694    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"]
Jul 23 16:57:03.629335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.629069    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dff5399-efc4-4e8f-8554-1efa741f7af9" containerName="main"
Jul 23 16:57:03.629335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.629081    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dff5399-efc4-4e8f-8554-1efa741f7af9" containerName="main"
Jul 23 16:57:03.629335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.629097    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" containerName="main"
Jul 23 16:57:03.629335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.629102    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" containerName="main"
Jul 23 16:57:03.629335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.629155    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22ec902-5a76-46bf-bbc5-6d8a6b038f0b" containerName="main"
Jul 23 16:57:03.629335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.629163    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dff5399-efc4-4e8f-8554-1efa741f7af9" containerName="main"
Jul 23 16:57:03.632179 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.632160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.635829 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.635801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"default-dockercfg-t9skl\""
Jul 23 16:57:03.635829 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.635801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"auth-test-model-dc9a69-kserve-self-signed-certs\""
Jul 23 16:57:03.636057 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.636040    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"openshift-service-ca.crt\""
Jul 23 16:57:03.636134 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.636081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"kube-root-ca.crt\""
Jul 23 16:57:03.642077 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.642053    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"]
Jul 23 16:57:03.777546 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.777510    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tls-certs\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.777738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.777563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-model-cache\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.777738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.777592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-dshm\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.777738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.777643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-home\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.777738 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.777715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tmp-dir\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.777937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.777763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmrj5\" (UniqueName: \"kubernetes.io/projected/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-kube-api-access-bmrj5\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879089 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.878978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tmp-dir\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879093    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmrj5\" (UniqueName: \"kubernetes.io/projected/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-kube-api-access-bmrj5\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tls-certs\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-model-cache\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879247 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-dshm\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-home\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tmp-dir\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879493 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-model-cache\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.879668 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.879650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-home\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.881451 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.881424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-dshm\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.881734 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.881712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tls-certs\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.888294 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.888269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmrj5\" (UniqueName: \"kubernetes.io/projected/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-kube-api-access-bmrj5\") pod \"auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") " pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:03.943162 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:03.943141    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:04.073254 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:04.073189    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"]
Jul 23 16:57:04.077424 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:57:04.077380    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c08ba13_1bd4_4f90_ad89_4bc3fcd04ea5.slice/crio-f5fdc36081bede9c3e3768bcf8495ff39fa1f3a29723d2a099dc6c53612e1580 WatchSource:0}: Error finding container f5fdc36081bede9c3e3768bcf8495ff39fa1f3a29723d2a099dc6c53612e1580: Status 404 returned error can't find the container with id f5fdc36081bede9c3e3768bcf8495ff39fa1f3a29723d2a099dc6c53612e1580
Jul 23 16:57:04.987872 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:04.987771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh" event={"ID":"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5","Type":"ContainerStarted","Data":"17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028"}
Jul 23 16:57:04.987872 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:04.987813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh" event={"ID":"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5","Type":"ContainerStarted","Data":"f5fdc36081bede9c3e3768bcf8495ff39fa1f3a29723d2a099dc6c53612e1580"}
Jul 23 16:57:05.006028 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:05.005973    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh" podStartSLOduration=2.005954434 podStartE2EDuration="2.005954434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:57:05.00351872 +0000 UTC m=+2478.408886004" watchObservedRunningTime="2026-07-23 16:57:05.005954434 +0000 UTC m=+2478.411321691"
Jul 23 16:57:06.835082 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:06.835048    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:57:13.944009 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:13.943971    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:13.944453 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:13.944024    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:13.956549 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:13.956525    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:14.038938 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:14.038912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:57:21.228802 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.228767    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"]
Jul 23 16:57:21.232321 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.232282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.235693 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.235660    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"openshift-service-ca.crt\""
Jul 23 16:57:21.236810 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.236781    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"kube-root-ca.crt\""
Jul 23 16:57:21.236959 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.236824    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"default-dockercfg-ktstc\""
Jul 23 16:57:21.237107 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.237091    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"auth-test-model-6a0c6b-kserve-self-signed-certs\""
Jul 23 16:57:21.247765 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.247730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"]
Jul 23 16:57:21.343536 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.343501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-model-cache\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.343536 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.343540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chk68\" (UniqueName: \"kubernetes.io/projected/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-kube-api-access-chk68\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.343774 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.343563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-home\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.343774 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.343637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tmp-dir\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.343774 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.343667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tls-certs\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.343774 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.343720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-dshm\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-model-cache\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445064 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chk68\" (UniqueName: \"kubernetes.io/projected/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-kube-api-access-chk68\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-home\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tmp-dir\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tls-certs\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445335 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-dshm\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445543 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-model-cache\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445599 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tmp-dir\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.445652 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.445598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-home\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.447529 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.447500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-dshm\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.447920 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.447898    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tls-certs\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.455491 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.455467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chk68\" (UniqueName: \"kubernetes.io/projected/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-kube-api-access-chk68\") pod \"auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") " pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.546470 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.546366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:21.686093 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:21.685757    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"]
Jul 23 16:57:21.688815 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:57:21.688784    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf08aae5a_c2ae_4348_8aa1_5eabf3918b31.slice/crio-0657fbc495fc009863db1e0e428ae14b52283907c242251b658a3627afe0e4ba WatchSource:0}: Error finding container 0657fbc495fc009863db1e0e428ae14b52283907c242251b658a3627afe0e4ba: Status 404 returned error can't find the container with id 0657fbc495fc009863db1e0e428ae14b52283907c242251b658a3627afe0e4ba
Jul 23 16:57:22.066744 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:22.066704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" event={"ID":"f08aae5a-c2ae-4348-8aa1-5eabf3918b31","Type":"ContainerStarted","Data":"dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c"}
Jul 23 16:57:22.066943 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:22.066753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" event={"ID":"f08aae5a-c2ae-4348-8aa1-5eabf3918b31","Type":"ContainerStarted","Data":"0657fbc495fc009863db1e0e428ae14b52283907c242251b658a3627afe0e4ba"}
Jul 23 16:57:22.083835 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:22.083777    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" podStartSLOduration=1.083750618 podStartE2EDuration="1.083750618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:57:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:57:22.08229462 +0000 UTC m=+2495.487661891" watchObservedRunningTime="2026-07-23 16:57:22.083750618 +0000 UTC m=+2495.489117877"
Jul 23 16:57:25.322424 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:25.322388    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:57:31.547101 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:31.547061    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:31.547496 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:31.547121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:31.559645 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:31.559621    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:32.126464 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:32.126437    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:57:40.132334 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:40.132301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:57:59.136280 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:57:59.136245    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:58:16.942801 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:58:16.942763    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:58:32.931402 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:58:32.931361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:58:52.230529 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:58:52.230494    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:59:11.230032 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:11.229946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:59:25.718595 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:25.718562    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"]
Jul 23 16:59:26.851025 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:26.850987    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"]
Jul 23 16:59:30.827422 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:30.827385    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:59:40.738168 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:40.738108    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh" podUID="2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" containerName="main" containerID="cri-o://17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028" gracePeriod=45
Jul 23 16:59:40.998447 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:40.998380    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:59:41.121608 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.121572    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-dshm\") pod \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") "
Jul 23 16:59:41.121798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.121619    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tls-certs\") pod \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") "
Jul 23 16:59:41.121798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.121699    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmrj5\" (UniqueName: \"kubernetes.io/projected/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-kube-api-access-bmrj5\") pod \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") "
Jul 23 16:59:41.121798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.121718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-home\") pod \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") "
Jul 23 16:59:41.121798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.121736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-model-cache\") pod \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") "
Jul 23 16:59:41.121798 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.121791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tmp-dir\") pod \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\" (UID: \"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5\") "
Jul 23 16:59:41.122122 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.122068    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-home" (OuterVolumeSpecName: "home") pod "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" (UID: "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:41.122182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.122123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" (UID: "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:41.122351 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.122302    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" (UID: "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:41.124030 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.124000    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-kube-api-access-bmrj5" (OuterVolumeSpecName: "kube-api-access-bmrj5") pod "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" (UID: "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5"). InnerVolumeSpecName "kube-api-access-bmrj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:59:41.124122 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.124034    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-dshm" (OuterVolumeSpecName: "dshm") pod "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" (UID: "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:41.124122 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.124111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" (UID: "2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:59:41.222691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.222650    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:41.222691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.222684    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:41.222691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.222695    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:41.222691 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.222702    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:41.222997 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.222710    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:41.222997 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.222718    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmrj5\" (UniqueName: \"kubernetes.io/projected/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5-kube-api-access-bmrj5\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:41.730971 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.730937    2582 generic.go:356] "Generic (PLEG): container finished" podID="2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" containerID="17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028" exitCode=0
Jul 23 16:59:41.731154 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.730985    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"
Jul 23 16:59:41.731154 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.730992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh" event={"ID":"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5","Type":"ContainerDied","Data":"17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028"}
Jul 23 16:59:41.731154 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.731031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh" event={"ID":"2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5","Type":"ContainerDied","Data":"f5fdc36081bede9c3e3768bcf8495ff39fa1f3a29723d2a099dc6c53612e1580"}
Jul 23 16:59:41.731154 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.731049    2582 scope.go:117] "RemoveContainer" containerID="17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028"
Jul 23 16:59:41.747006 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.746817    2582 scope.go:117] "RemoveContainer" containerID="17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028"
Jul 23 16:59:41.747243 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:59:41.747152    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028\": container with ID starting with 17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028 not found: ID does not exist" containerID="17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028"
Jul 23 16:59:41.747243 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.747177    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028"} err="failed to get container status \"17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028\": rpc error: code = NotFound desc = could not find container \"17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028\": container with ID starting with 17a43fbf95a99ca945f9efe5260e099dd547373313533c45096999d5206e4028 not found: ID does not exist"
Jul 23 16:59:41.755538 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.755509    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"]
Jul 23 16:59:41.758330 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.758306    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/auth-test-model-dc9a69-kserve-84bcdf8c87-vrwzh"]
Jul 23 16:59:41.873003 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:41.872932    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" podUID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" containerName="main" containerID="cri-o://dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c" gracePeriod=45
Jul 23 16:59:42.126254 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.126180    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:59:42.230785 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.230738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chk68\" (UniqueName: \"kubernetes.io/projected/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-kube-api-access-chk68\") pod \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") "
Jul 23 16:59:42.230785 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.230784    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tmp-dir\") pod \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") "
Jul 23 16:59:42.231085 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.230802    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tls-certs\") pod \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") "
Jul 23 16:59:42.231085 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.230825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-home\") pod \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") "
Jul 23 16:59:42.231085 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.230883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-model-cache\") pod \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") "
Jul 23 16:59:42.231085 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.230928    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-dshm\") pod \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\" (UID: \"f08aae5a-c2ae-4348-8aa1-5eabf3918b31\") "
Jul 23 16:59:42.231287 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.231137    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f08aae5a-c2ae-4348-8aa1-5eabf3918b31" (UID: "f08aae5a-c2ae-4348-8aa1-5eabf3918b31"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:42.231287 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.231168    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-model-cache" (OuterVolumeSpecName: "model-cache") pod "f08aae5a-c2ae-4348-8aa1-5eabf3918b31" (UID: "f08aae5a-c2ae-4348-8aa1-5eabf3918b31"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:42.231287 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.231168    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-home" (OuterVolumeSpecName: "home") pod "f08aae5a-c2ae-4348-8aa1-5eabf3918b31" (UID: "f08aae5a-c2ae-4348-8aa1-5eabf3918b31"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:42.231391 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.231299    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:42.231391 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.231314    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:42.231391 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.231322    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:42.233250 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.233228    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-kube-api-access-chk68" (OuterVolumeSpecName: "kube-api-access-chk68") pod "f08aae5a-c2ae-4348-8aa1-5eabf3918b31" (UID: "f08aae5a-c2ae-4348-8aa1-5eabf3918b31"). InnerVolumeSpecName "kube-api-access-chk68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:59:42.233343 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.233326    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f08aae5a-c2ae-4348-8aa1-5eabf3918b31" (UID: "f08aae5a-c2ae-4348-8aa1-5eabf3918b31"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:59:42.233395 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.233354    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-dshm" (OuterVolumeSpecName: "dshm") pod "f08aae5a-c2ae-4348-8aa1-5eabf3918b31" (UID: "f08aae5a-c2ae-4348-8aa1-5eabf3918b31"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:59:42.332358 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.332323    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:42.332358 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.332353    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chk68\" (UniqueName: \"kubernetes.io/projected/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-kube-api-access-chk68\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:42.332358 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.332364    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f08aae5a-c2ae-4348-8aa1-5eabf3918b31-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 16:59:42.737981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.737937    2582 generic.go:356] "Generic (PLEG): container finished" podID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" containerID="dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c" exitCode=0
Jul 23 16:59:42.737981 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.737978    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"
Jul 23 16:59:42.738227 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.738013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" event={"ID":"f08aae5a-c2ae-4348-8aa1-5eabf3918b31","Type":"ContainerDied","Data":"dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c"}
Jul 23 16:59:42.738227 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.738064    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" event={"ID":"f08aae5a-c2ae-4348-8aa1-5eabf3918b31","Type":"ContainerDied","Data":"0657fbc495fc009863db1e0e428ae14b52283907c242251b658a3627afe0e4ba"}
Jul 23 16:59:42.738227 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.738089    2582 scope.go:117] "RemoveContainer" containerID="dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c"
Jul 23 16:59:42.747750 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.747593    2582 scope.go:117] "RemoveContainer" containerID="dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c"
Jul 23 16:59:42.748046 ip-10-0-131-182 kubenswrapper[2582]: E0723 16:59:42.747958    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c\": container with ID starting with dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c not found: ID does not exist" containerID="dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c"
Jul 23 16:59:42.748046 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.747984    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c"} err="failed to get container status \"dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c\": rpc error: code = NotFound desc = could not find container \"dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c\": container with ID starting with dbe84b76cd62402b712087e1497b128248f740f3d8b01dfe9459c322f91b116c not found: ID does not exist"
Jul 23 16:59:42.759598 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.759563    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"]
Jul 23 16:59:42.761221 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:42.761200    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz"]
Jul 23 16:59:43.593536 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:43.593504    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" path="/var/lib/kubelet/pods/2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5/volumes"
Jul 23 16:59:43.593934 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:43.593920    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" path="/var/lib/kubelet/pods/f08aae5a-c2ae-4348-8aa1-5eabf3918b31/volumes"
Jul 23 16:59:46.124475 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.124437    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"]
Jul 23 16:59:46.124889 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.124880    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" containerName="main"
Jul 23 16:59:46.124937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.124894    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" containerName="main"
Jul 23 16:59:46.124937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.124918    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" containerName="main"
Jul 23 16:59:46.124937 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.124924    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" containerName="main"
Jul 23 16:59:46.125032 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.124992    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" containerName="main"
Jul 23 16:59:46.125032 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.125003    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c08ba13-1bd4-4f90-ad89-4bc3fcd04ea5" containerName="main"
Jul 23 16:59:46.129346 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.129326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.133367 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.133332    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"kube-root-ca.crt\""
Jul 23 16:59:46.133656 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.133634    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"openshift-service-ca.crt\""
Jul 23 16:59:46.133943 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.133923    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"sub-test-model-dc9a69-kserve-self-signed-certs\""
Jul 23 16:59:46.134770 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.134737    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"default-dockercfg-t9skl\""
Jul 23 16:59:46.138688 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.138665    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"]
Jul 23 16:59:46.269607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.269564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-dshm\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.269607 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.269606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-home\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.269938 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.269691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-model-cache\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.269938 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.269769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-tmp-dir\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.269938 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.269799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvk2\" (UniqueName: \"kubernetes.io/projected/d56a4e2d-9999-42b2-9954-c792f079ddd4-kube-api-access-7rvk2\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.269938 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.269893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d56a4e2d-9999-42b2-9954-c792f079ddd4-tls-certs\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.370978 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.370932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-model-cache\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-tmp-dir\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvk2\" (UniqueName: \"kubernetes.io/projected/d56a4e2d-9999-42b2-9954-c792f079ddd4-kube-api-access-7rvk2\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d56a4e2d-9999-42b2-9954-c792f079ddd4-tls-certs\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-dshm\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371182 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-home\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371457 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-model-cache\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371518 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-home\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.371995 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.371965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-tmp-dir\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.374165 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.374131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d56a4e2d-9999-42b2-9954-c792f079ddd4-tls-certs\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.374326 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.374310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-dshm\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.383740 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.383661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvk2\" (UniqueName: \"kubernetes.io/projected/d56a4e2d-9999-42b2-9954-c792f079ddd4-kube-api-access-7rvk2\") pod \"sub-test-model-dc9a69-kserve-7d8876b7f-x6p98\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") " pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.441573 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.441527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:46.583910 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.583680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"]
Jul 23 16:59:46.586677 ip-10-0-131-182 kubenswrapper[2582]: W0723 16:59:46.586650    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd56a4e2d_9999_42b2_9954_c792f079ddd4.slice/crio-74bd3105572c250d4c00c21421c11f734b51309d04f6112f7957ee131c0bc1c2 WatchSource:0}: Error finding container 74bd3105572c250d4c00c21421c11f734b51309d04f6112f7957ee131c0bc1c2: Status 404 returned error can't find the container with id 74bd3105572c250d4c00c21421c11f734b51309d04f6112f7957ee131c0bc1c2
Jul 23 16:59:46.762307 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.762268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98" event={"ID":"d56a4e2d-9999-42b2-9954-c792f079ddd4","Type":"ContainerStarted","Data":"1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f"}
Jul 23 16:59:46.762307 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.762313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98" event={"ID":"d56a4e2d-9999-42b2-9954-c792f079ddd4","Type":"ContainerStarted","Data":"74bd3105572c250d4c00c21421c11f734b51309d04f6112f7957ee131c0bc1c2"}
Jul 23 16:59:46.784483 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:46.784420    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98" podStartSLOduration=0.784402379 podStartE2EDuration="784.402379ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:59:46.783478461 +0000 UTC m=+2640.188845720" watchObservedRunningTime="2026-07-23 16:59:46.784402379 +0000 UTC m=+2640.189769637"
Jul 23 16:59:47.116120 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:47.116050    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-6a0c6b/auth-test-model-6a0c6b-kserve-8474dd7ddc-7kqxz" podUID="f08aae5a-c2ae-4348-8aa1-5eabf3918b31" containerName="main" probeResult="failure" output="Get \"https://10.134.0.40:8000/ready\": context deadline exceeded"
Jul 23 16:59:50.136059 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:50.136025    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 16:59:56.442392 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:56.442355    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:56.442924 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:56.442675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:56.455154 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:56.455132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 16:59:56.821676 ip-10-0-131-182 kubenswrapper[2582]: I0723 16:59:56.821590    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 17:00:14.614371 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.614334    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"]
Jul 23 17:00:14.617909 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.617886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.621776 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.621748    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"default-dockercfg-ktstc\""
Jul 23 17:00:14.621974 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.621748    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"sub-test-model-6a0c6b-kserve-self-signed-certs\""
Jul 23 17:00:14.621974 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.621758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"kube-root-ca.crt\""
Jul 23 17:00:14.621974 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.621787    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"openshift-service-ca.crt\""
Jul 23 17:00:14.627666 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.627638    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"]
Jul 23 17:00:14.726790 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.726750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-model-cache\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.726790 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.726793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-tmp-dir\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.727063 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.726839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m46lx\" (UniqueName: \"kubernetes.io/projected/c143be2f-464c-4632-82ad-30c4d6cdd855-kube-api-access-m46lx\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.727063 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.726897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-dshm\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.727063 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.726914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c143be2f-464c-4632-82ad-30c4d6cdd855-tls-certs\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.727063 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.726978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-home\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-model-cache\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-tmp-dir\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828615 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m46lx\" (UniqueName: \"kubernetes.io/projected/c143be2f-464c-4632-82ad-30c4d6cdd855-kube-api-access-m46lx\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828615 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-dshm\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828615 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c143be2f-464c-4632-82ad-30c4d6cdd855-tls-certs\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828615 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-home\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828840 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-model-cache\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828944 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-tmp-dir\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.828944 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.828928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-home\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.830924 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.830895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-dshm\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.831089 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.831073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c143be2f-464c-4632-82ad-30c4d6cdd855-tls-certs\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.837277 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.837251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m46lx\" (UniqueName: \"kubernetes.io/projected/c143be2f-464c-4632-82ad-30c4d6cdd855-kube-api-access-m46lx\") pod \"sub-test-model-6a0c6b-kserve-c4975647-b7gbz\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") " pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:14.929030 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:14.928930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:15.075351 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:15.074941    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"]
Jul 23 17:00:15.076716 ip-10-0-131-182 kubenswrapper[2582]: W0723 17:00:15.076674    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc143be2f_464c_4632_82ad_30c4d6cdd855.slice/crio-eaec813c6f9482d4e2129a2195157d81f82a6da3ffd8344a44192fa52d438e97 WatchSource:0}: Error finding container eaec813c6f9482d4e2129a2195157d81f82a6da3ffd8344a44192fa52d438e97: Status 404 returned error can't find the container with id eaec813c6f9482d4e2129a2195157d81f82a6da3ffd8344a44192fa52d438e97
Jul 23 17:00:15.899075 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:15.899039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz" event={"ID":"c143be2f-464c-4632-82ad-30c4d6cdd855","Type":"ContainerStarted","Data":"35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80"}
Jul 23 17:00:15.899075 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:15.899084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz" event={"ID":"c143be2f-464c-4632-82ad-30c4d6cdd855","Type":"ContainerStarted","Data":"eaec813c6f9482d4e2129a2195157d81f82a6da3ffd8344a44192fa52d438e97"}
Jul 23 17:00:17.336657 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:17.336600    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz" podStartSLOduration=3.336579385 podStartE2EDuration="3.336579385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:00:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:00:15.916894692 +0000 UTC m=+2669.322261950" watchObservedRunningTime="2026-07-23 17:00:17.336579385 +0000 UTC m=+2670.741946643"
Jul 23 17:00:17.338049 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:17.338030    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:00:24.929834 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:24.929802    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:24.930260 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:24.929884    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:24.943398 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:24.943364    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:25.956729 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:25.956703    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:00:33.734190 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:33.734153    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:00:51.432189 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:51.432151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:00:57.721225 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:57.721186    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"]
Jul 23 17:00:58.719741 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:00:58.719707    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"]
Jul 23 17:01:09.824734 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:09.824698    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:01:12.741469 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:12.741425    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98" podUID="d56a4e2d-9999-42b2-9954-c792f079ddd4" containerName="main" containerID="cri-o://1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f" gracePeriod=45
Jul 23 17:01:13.004110 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.004049    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 17:01:13.084351 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084317    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-dshm\") pod \"d56a4e2d-9999-42b2-9954-c792f079ddd4\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") "
Jul 23 17:01:13.084532 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-home\") pod \"d56a4e2d-9999-42b2-9954-c792f079ddd4\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") "
Jul 23 17:01:13.084532 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084441    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rvk2\" (UniqueName: \"kubernetes.io/projected/d56a4e2d-9999-42b2-9954-c792f079ddd4-kube-api-access-7rvk2\") pod \"d56a4e2d-9999-42b2-9954-c792f079ddd4\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") "
Jul 23 17:01:13.084532 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084458    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d56a4e2d-9999-42b2-9954-c792f079ddd4-tls-certs\") pod \"d56a4e2d-9999-42b2-9954-c792f079ddd4\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") "
Jul 23 17:01:13.084532 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084508    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-tmp-dir\") pod \"d56a4e2d-9999-42b2-9954-c792f079ddd4\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") "
Jul 23 17:01:13.084885 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084567    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-model-cache\") pod \"d56a4e2d-9999-42b2-9954-c792f079ddd4\" (UID: \"d56a4e2d-9999-42b2-9954-c792f079ddd4\") "
Jul 23 17:01:13.084885 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084725    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-home" (OuterVolumeSpecName: "home") pod "d56a4e2d-9999-42b2-9954-c792f079ddd4" (UID: "d56a4e2d-9999-42b2-9954-c792f079ddd4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:13.084998 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084892    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:13.084998 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084982    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-model-cache" (OuterVolumeSpecName: "model-cache") pod "d56a4e2d-9999-42b2-9954-c792f079ddd4" (UID: "d56a4e2d-9999-42b2-9954-c792f079ddd4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:13.085111 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.084997    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d56a4e2d-9999-42b2-9954-c792f079ddd4" (UID: "d56a4e2d-9999-42b2-9954-c792f079ddd4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:13.086608 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.086579    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-dshm" (OuterVolumeSpecName: "dshm") pod "d56a4e2d-9999-42b2-9954-c792f079ddd4" (UID: "d56a4e2d-9999-42b2-9954-c792f079ddd4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:13.086705 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.086662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56a4e2d-9999-42b2-9954-c792f079ddd4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d56a4e2d-9999-42b2-9954-c792f079ddd4" (UID: "d56a4e2d-9999-42b2-9954-c792f079ddd4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:01:13.086754 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.086712    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56a4e2d-9999-42b2-9954-c792f079ddd4-kube-api-access-7rvk2" (OuterVolumeSpecName: "kube-api-access-7rvk2") pod "d56a4e2d-9999-42b2-9954-c792f079ddd4" (UID: "d56a4e2d-9999-42b2-9954-c792f079ddd4"). InnerVolumeSpecName "kube-api-access-7rvk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:01:13.182488 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.182453    2582 generic.go:356] "Generic (PLEG): container finished" podID="d56a4e2d-9999-42b2-9954-c792f079ddd4" containerID="1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f" exitCode=0
Jul 23 17:01:13.182488 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.182491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98" event={"ID":"d56a4e2d-9999-42b2-9954-c792f079ddd4","Type":"ContainerDied","Data":"1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f"}
Jul 23 17:01:13.182742 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.182504    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"
Jul 23 17:01:13.182742 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.182517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98" event={"ID":"d56a4e2d-9999-42b2-9954-c792f079ddd4","Type":"ContainerDied","Data":"74bd3105572c250d4c00c21421c11f734b51309d04f6112f7957ee131c0bc1c2"}
Jul 23 17:01:13.182742 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.182534    2582 scope.go:117] "RemoveContainer" containerID="1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f"
Jul 23 17:01:13.185538 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.185517    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rvk2\" (UniqueName: \"kubernetes.io/projected/d56a4e2d-9999-42b2-9954-c792f079ddd4-kube-api-access-7rvk2\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:13.185538 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.185538    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d56a4e2d-9999-42b2-9954-c792f079ddd4-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:13.185538 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.185548    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:13.185780 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.185556    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:13.185780 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.185564    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d56a4e2d-9999-42b2-9954-c792f079ddd4-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:13.191602 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.191587    2582 scope.go:117] "RemoveContainer" containerID="1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f"
Jul 23 17:01:13.191834 ip-10-0-131-182 kubenswrapper[2582]: E0723 17:01:13.191817    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f\": container with ID starting with 1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f not found: ID does not exist" containerID="1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f"
Jul 23 17:01:13.191961 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.191877    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f"} err="failed to get container status \"1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f\": rpc error: code = NotFound desc = could not find container \"1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f\": container with ID starting with 1f4f4e282ac81a4bb87358d8be3eba40c655db99dfe528b3e248210accdc138f not found: ID does not exist"
Jul 23 17:01:13.203789 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.203758    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"]
Jul 23 17:01:13.207707 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.207675    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/sub-test-model-dc9a69-kserve-7d8876b7f-x6p98"]
Jul 23 17:01:13.592430 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.592398    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56a4e2d-9999-42b2-9954-c792f079ddd4" path="/var/lib/kubelet/pods/d56a4e2d-9999-42b2-9954-c792f079ddd4/volumes"
Jul 23 17:01:13.730374 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.730317    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"]
Jul 23 17:01:13.730809 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.730791    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56a4e2d-9999-42b2-9954-c792f079ddd4" containerName="main"
Jul 23 17:01:13.730809 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.730810    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56a4e2d-9999-42b2-9954-c792f079ddd4" containerName="main"
Jul 23 17:01:13.730932 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.730897    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56a4e2d-9999-42b2-9954-c792f079ddd4" containerName="main"
Jul 23 17:01:13.735236 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.735210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.739004 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.738942    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"rate-test-model-dc9a69-kserve-self-signed-certs\""
Jul 23 17:01:13.739004 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.738973    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"kube-root-ca.crt\""
Jul 23 17:01:13.739171 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.739025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"openshift-service-ca.crt\""
Jul 23 17:01:13.739171 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.739030    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dc9a69\"/\"default-dockercfg-t9skl\""
Jul 23 17:01:13.740092 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.740058    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz" podUID="c143be2f-464c-4632-82ad-30c4d6cdd855" containerName="main" containerID="cri-o://35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80" gracePeriod=45
Jul 23 17:01:13.744452 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.744428    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"]
Jul 23 17:01:13.891558 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.891522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-model-cache\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.891748 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.891578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tmp-dir\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.891748 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.891670    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88cgd\" (UniqueName: \"kubernetes.io/projected/3fcff789-7df3-4c80-a9fc-884b4ca49f42-kube-api-access-88cgd\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.891748 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.891716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tls-certs\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.891902 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.891778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-dshm\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.891902 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.891816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-home\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.992604 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.992549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-model-cache\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.992737 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.992644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tmp-dir\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.992737 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.992700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88cgd\" (UniqueName: \"kubernetes.io/projected/3fcff789-7df3-4c80-a9fc-884b4ca49f42-kube-api-access-88cgd\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.992887 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.992750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tls-certs\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.992887 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.992790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-dshm\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.992887 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.992819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-home\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.993043 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.993011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-model-cache\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.993178 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.993157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tmp-dir\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.993246 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.993212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-home\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.995345 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.995328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-dshm\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.995542 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.995515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tls-certs\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:13.998624 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:13.998603    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:01:14.000647 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.000625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88cgd\" (UniqueName: \"kubernetes.io/projected/3fcff789-7df3-4c80-a9fc-884b4ca49f42-kube-api-access-88cgd\") pod \"rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") " pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:14.045567 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.045538    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:14.093876 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.093705    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-tmp-dir\") pod \"c143be2f-464c-4632-82ad-30c4d6cdd855\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") "
Jul 23 17:01:14.093876 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.093821    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c143be2f-464c-4632-82ad-30c4d6cdd855-tls-certs\") pod \"c143be2f-464c-4632-82ad-30c4d6cdd855\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") "
Jul 23 17:01:14.093876 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.093871    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-home\") pod \"c143be2f-464c-4632-82ad-30c4d6cdd855\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") "
Jul 23 17:01:14.094149 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.093902    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m46lx\" (UniqueName: \"kubernetes.io/projected/c143be2f-464c-4632-82ad-30c4d6cdd855-kube-api-access-m46lx\") pod \"c143be2f-464c-4632-82ad-30c4d6cdd855\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") "
Jul 23 17:01:14.094149 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.093924    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-dshm\") pod \"c143be2f-464c-4632-82ad-30c4d6cdd855\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") "
Jul 23 17:01:14.094149 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.093988    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-model-cache\") pod \"c143be2f-464c-4632-82ad-30c4d6cdd855\" (UID: \"c143be2f-464c-4632-82ad-30c4d6cdd855\") "
Jul 23 17:01:14.094149 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.094031    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c143be2f-464c-4632-82ad-30c4d6cdd855" (UID: "c143be2f-464c-4632-82ad-30c4d6cdd855"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:14.094346 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.094198    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-home" (OuterVolumeSpecName: "home") pod "c143be2f-464c-4632-82ad-30c4d6cdd855" (UID: "c143be2f-464c-4632-82ad-30c4d6cdd855"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:14.094346 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.094327    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:14.094346 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.094345    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:14.094551 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.094530    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-model-cache" (OuterVolumeSpecName: "model-cache") pod "c143be2f-464c-4632-82ad-30c4d6cdd855" (UID: "c143be2f-464c-4632-82ad-30c4d6cdd855"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:14.097239 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.097170    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c143be2f-464c-4632-82ad-30c4d6cdd855-kube-api-access-m46lx" (OuterVolumeSpecName: "kube-api-access-m46lx") pod "c143be2f-464c-4632-82ad-30c4d6cdd855" (UID: "c143be2f-464c-4632-82ad-30c4d6cdd855"). InnerVolumeSpecName "kube-api-access-m46lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:01:14.097357 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.097291    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c143be2f-464c-4632-82ad-30c4d6cdd855-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c143be2f-464c-4632-82ad-30c4d6cdd855" (UID: "c143be2f-464c-4632-82ad-30c4d6cdd855"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:01:14.097694 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.097667    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-dshm" (OuterVolumeSpecName: "dshm") pod "c143be2f-464c-4632-82ad-30c4d6cdd855" (UID: "c143be2f-464c-4632-82ad-30c4d6cdd855"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:01:14.175625 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.175598    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"]
Jul 23 17:01:14.178445 ip-10-0-131-182 kubenswrapper[2582]: W0723 17:01:14.178412    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fcff789_7df3_4c80_a9fc_884b4ca49f42.slice/crio-97bff6bcddebce6086b99626e79a11ba4cdb2b721cedc2f178934e46394132ed WatchSource:0}: Error finding container 97bff6bcddebce6086b99626e79a11ba4cdb2b721cedc2f178934e46394132ed: Status 404 returned error can't find the container with id 97bff6bcddebce6086b99626e79a11ba4cdb2b721cedc2f178934e46394132ed
Jul 23 17:01:14.188385 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.188362    2582 generic.go:356] "Generic (PLEG): container finished" podID="c143be2f-464c-4632-82ad-30c4d6cdd855" containerID="35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80" exitCode=0
Jul 23 17:01:14.188492 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.188407    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"
Jul 23 17:01:14.188492 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.188426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz" event={"ID":"c143be2f-464c-4632-82ad-30c4d6cdd855","Type":"ContainerDied","Data":"35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80"}
Jul 23 17:01:14.188492 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.188464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz" event={"ID":"c143be2f-464c-4632-82ad-30c4d6cdd855","Type":"ContainerDied","Data":"eaec813c6f9482d4e2129a2195157d81f82a6da3ffd8344a44192fa52d438e97"}
Jul 23 17:01:14.188621 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.188493    2582 scope.go:117] "RemoveContainer" containerID="35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80"
Jul 23 17:01:14.189755 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.189731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft" event={"ID":"3fcff789-7df3-4c80-a9fc-884b4ca49f42","Type":"ContainerStarted","Data":"97bff6bcddebce6086b99626e79a11ba4cdb2b721cedc2f178934e46394132ed"}
Jul 23 17:01:14.194995 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.194973    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c143be2f-464c-4632-82ad-30c4d6cdd855-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:14.195141 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.195126    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m46lx\" (UniqueName: \"kubernetes.io/projected/c143be2f-464c-4632-82ad-30c4d6cdd855-kube-api-access-m46lx\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:14.195243 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.195231    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:14.195330 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.195319    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c143be2f-464c-4632-82ad-30c4d6cdd855-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:01:14.200761 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.200733    2582 scope.go:117] "RemoveContainer" containerID="35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80"
Jul 23 17:01:14.201303 ip-10-0-131-182 kubenswrapper[2582]: E0723 17:01:14.201282    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80\": container with ID starting with 35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80 not found: ID does not exist" containerID="35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80"
Jul 23 17:01:14.201422 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.201309    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80"} err="failed to get container status \"35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80\": rpc error: code = NotFound desc = could not find container \"35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80\": container with ID starting with 35473523eb7b591889a5f28c973f19c58bbb171cb5327cb84f30a7f531dc6d80 not found: ID does not exist"
Jul 23 17:01:14.213608 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.213578    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"]
Jul 23 17:01:14.218539 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:14.218512    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/sub-test-model-6a0c6b-kserve-c4975647-b7gbz"]
Jul 23 17:01:15.201213 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:15.201145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft" event={"ID":"3fcff789-7df3-4c80-a9fc-884b4ca49f42","Type":"ContainerStarted","Data":"5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c"}
Jul 23 17:01:15.219996 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:15.219938    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft" podStartSLOduration=2.219918159 podStartE2EDuration="2.219918159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:01:15.219060779 +0000 UTC m=+2728.624428039" watchObservedRunningTime="2026-07-23 17:01:15.219918159 +0000 UTC m=+2728.625285419"
Jul 23 17:01:15.592914 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:15.592822    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c143be2f-464c-4632-82ad-30c4d6cdd855" path="/var/lib/kubelet/pods/c143be2f-464c-4632-82ad-30c4d6cdd855/volumes"
Jul 23 17:01:20.040119 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:20.040085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:01:24.045986 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:24.045943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:24.046376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:24.046010    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:24.058515 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:24.058484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:01:24.254100 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:01:24.254073    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:02:01.220446 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.220411    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"]
Jul 23 17:02:01.220928 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.220896    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c143be2f-464c-4632-82ad-30c4d6cdd855" containerName="main"
Jul 23 17:02:01.220928 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.220912    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c143be2f-464c-4632-82ad-30c4d6cdd855" containerName="main"
Jul 23 17:02:01.221025 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.220983    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c143be2f-464c-4632-82ad-30c4d6cdd855" containerName="main"
Jul 23 17:02:01.223838 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.223819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.227996 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.227969    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"kube-root-ca.crt\""
Jul 23 17:02:01.228126 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.228005    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"openshift-service-ca.crt\""
Jul 23 17:02:01.229207 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.229187    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"default-dockercfg-ktstc\""
Jul 23 17:02:01.229321 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.229252    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6a0c6b\"/\"rate-test-model-6a0c6b-kserve-self-signed-certs\""
Jul 23 17:02:01.236715 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.236687    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"]
Jul 23 17:02:01.342298 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.342265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-dshm\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.342479 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.342301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-model-cache\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.342479 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.342336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tls-certs\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.342479 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.342449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tmp-dir\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.342641 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.342495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-home\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.342641 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.342530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwnd\" (UniqueName: \"kubernetes.io/projected/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-kube-api-access-bvwnd\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.443975 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.443938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-dshm\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.443975 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.443974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-model-cache\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444252 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.443991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tls-certs\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444252 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.444134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tmp-dir\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444252 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.444182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-home\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444252 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.444203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwnd\" (UniqueName: \"kubernetes.io/projected/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-kube-api-access-bvwnd\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444478 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.444459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-model-cache\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444531 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.444477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-home\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.444568 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.444530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tmp-dir\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.446297 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.446275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-dshm\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.446633 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.446616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tls-certs\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.453445 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.453420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwnd\" (UniqueName: \"kubernetes.io/projected/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-kube-api-access-bvwnd\") pod \"rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") " pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.533573 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.533476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:01.674155 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:01.674120    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"]
Jul 23 17:02:01.676672 ip-10-0-131-182 kubenswrapper[2582]: W0723 17:02:01.676644    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e615d5a_3a2d_4eff_bb62_cbe692d154fe.slice/crio-378dfff4b237949fc26861a354cdfa5fe7966120b694c46f1bfac575d99bc010 WatchSource:0}: Error finding container 378dfff4b237949fc26861a354cdfa5fe7966120b694c46f1bfac575d99bc010: Status 404 returned error can't find the container with id 378dfff4b237949fc26861a354cdfa5fe7966120b694c46f1bfac575d99bc010
Jul 23 17:02:02.419167 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:02.419128    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc" event={"ID":"2e615d5a-3a2d-4eff-bb62-cbe692d154fe","Type":"ContainerStarted","Data":"835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352"}
Jul 23 17:02:02.419653 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:02.419181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc" event={"ID":"2e615d5a-3a2d-4eff-bb62-cbe692d154fe","Type":"ContainerStarted","Data":"378dfff4b237949fc26861a354cdfa5fe7966120b694c46f1bfac575d99bc010"}
Jul 23 17:02:02.438656 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:02.438608    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc" podStartSLOduration=1.438593507 podStartE2EDuration="1.438593507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:02:02.43688969 +0000 UTC m=+2775.842256941" watchObservedRunningTime="2026-07-23 17:02:02.438593507 +0000 UTC m=+2775.843960769"
Jul 23 17:02:05.130236 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:05.130193    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:02:11.533804 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:11.533715    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:11.533804 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:11.533768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:11.546283 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:11.546255    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:12.478974 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:12.478944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:20.936667 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:20.936635    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:02:35.844336 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:35.844302    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:02:42.078526 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:42.078489    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"]
Jul 23 17:02:43.057820 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:43.057779    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"]
Jul 23 17:02:53.042779 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:53.042744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:02:57.099263 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.099217    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft" podUID="3fcff789-7df3-4c80-a9fc-884b4ca49f42" containerName="main" containerID="cri-o://5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c" gracePeriod=45
Jul 23 17:02:57.346625 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.346594    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:02:57.370576 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370541    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-model-cache\") pod \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") "
Jul 23 17:02:57.370767 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370596    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-dshm\") pod \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") "
Jul 23 17:02:57.370767 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370719    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tmp-dir\") pod \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") "
Jul 23 17:02:57.370767 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370745    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tls-certs\") pod \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") "
Jul 23 17:02:57.370964 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88cgd\" (UniqueName: \"kubernetes.io/projected/3fcff789-7df3-4c80-a9fc-884b4ca49f42-kube-api-access-88cgd\") pod \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") "
Jul 23 17:02:57.370964 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-home\") pod \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\" (UID: \"3fcff789-7df3-4c80-a9fc-884b4ca49f42\") "
Jul 23 17:02:57.370964 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.370883    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fcff789-7df3-4c80-a9fc-884b4ca49f42" (UID: "3fcff789-7df3-4c80-a9fc-884b4ca49f42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:57.371153 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.371134    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:57.371216 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.371148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fcff789-7df3-4c80-a9fc-884b4ca49f42" (UID: "3fcff789-7df3-4c80-a9fc-884b4ca49f42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:57.371396 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.371374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-home" (OuterVolumeSpecName: "home") pod "3fcff789-7df3-4c80-a9fc-884b4ca49f42" (UID: "3fcff789-7df3-4c80-a9fc-884b4ca49f42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:57.373326 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.373301    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fcff789-7df3-4c80-a9fc-884b4ca49f42-kube-api-access-88cgd" (OuterVolumeSpecName: "kube-api-access-88cgd") pod "3fcff789-7df3-4c80-a9fc-884b4ca49f42" (UID: "3fcff789-7df3-4c80-a9fc-884b4ca49f42"). InnerVolumeSpecName "kube-api-access-88cgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:57.373516 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.373488    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fcff789-7df3-4c80-a9fc-884b4ca49f42" (UID: "3fcff789-7df3-4c80-a9fc-884b4ca49f42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:02:57.373831 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.373804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-dshm" (OuterVolumeSpecName: "dshm") pod "3fcff789-7df3-4c80-a9fc-884b4ca49f42" (UID: "3fcff789-7df3-4c80-a9fc-884b4ca49f42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:57.472560 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.472524    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:57.472560 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.472556    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcff789-7df3-4c80-a9fc-884b4ca49f42-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:57.472560 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.472566    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88cgd\" (UniqueName: \"kubernetes.io/projected/3fcff789-7df3-4c80-a9fc-884b4ca49f42-kube-api-access-88cgd\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:57.472822 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.472576    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:57.472822 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.472585    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcff789-7df3-4c80-a9fc-884b4ca49f42-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:57.691194 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.691102    2582 generic.go:356] "Generic (PLEG): container finished" podID="3fcff789-7df3-4c80-a9fc-884b4ca49f42" containerID="5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c" exitCode=0
Jul 23 17:02:57.691194 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.691149    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"
Jul 23 17:02:57.691376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.691193    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft" event={"ID":"3fcff789-7df3-4c80-a9fc-884b4ca49f42","Type":"ContainerDied","Data":"5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c"}
Jul 23 17:02:57.691376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.691244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft" event={"ID":"3fcff789-7df3-4c80-a9fc-884b4ca49f42","Type":"ContainerDied","Data":"97bff6bcddebce6086b99626e79a11ba4cdb2b721cedc2f178934e46394132ed"}
Jul 23 17:02:57.691376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.691265    2582 scope.go:117] "RemoveContainer" containerID="5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c"
Jul 23 17:02:57.700402 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.700373    2582 scope.go:117] "RemoveContainer" containerID="5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c"
Jul 23 17:02:57.700712 ip-10-0-131-182 kubenswrapper[2582]: E0723 17:02:57.700692    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c\": container with ID starting with 5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c not found: ID does not exist" containerID="5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c"
Jul 23 17:02:57.700803 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.700722    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c"} err="failed to get container status \"5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c\": rpc error: code = NotFound desc = could not find container \"5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c\": container with ID starting with 5478c78b11a97807332247cb92fa8ce2de116a5b2bddb1e93a4f0cd5ec161a4c not found: ID does not exist"
Jul 23 17:02:57.708598 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.708564    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"]
Jul 23 17:02:57.710897 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:57.710865    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dc9a69/rate-test-model-dc9a69-kserve-64dfdfb587-pt7ft"]
Jul 23 17:02:58.081219 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.081117    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc" podUID="2e615d5a-3a2d-4eff-bb62-cbe692d154fe" containerName="main" containerID="cri-o://835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352" gracePeriod=45
Jul 23 17:02:58.347041 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.347011    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:58.383412 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tls-certs\") pod \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") "
Jul 23 17:02:58.383605 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383441    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tmp-dir\") pod \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") "
Jul 23 17:02:58.383605 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383489    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-dshm\") pod \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") "
Jul 23 17:02:58.383605 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvwnd\" (UniqueName: \"kubernetes.io/projected/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-kube-api-access-bvwnd\") pod \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") "
Jul 23 17:02:58.383605 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383589    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-model-cache\") pod \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") "
Jul 23 17:02:58.383605 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383604    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-home\") pod \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\" (UID: \"2e615d5a-3a2d-4eff-bb62-cbe692d154fe\") "
Jul 23 17:02:58.383881 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383714    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e615d5a-3a2d-4eff-bb62-cbe692d154fe" (UID: "2e615d5a-3a2d-4eff-bb62-cbe692d154fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:58.384044 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.383994    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tmp-dir\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:58.384109 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.384083    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e615d5a-3a2d-4eff-bb62-cbe692d154fe" (UID: "2e615d5a-3a2d-4eff-bb62-cbe692d154fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:58.384395 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.384367    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-home" (OuterVolumeSpecName: "home") pod "2e615d5a-3a2d-4eff-bb62-cbe692d154fe" (UID: "2e615d5a-3a2d-4eff-bb62-cbe692d154fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:58.386056 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.386012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e615d5a-3a2d-4eff-bb62-cbe692d154fe" (UID: "2e615d5a-3a2d-4eff-bb62-cbe692d154fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:02:58.386153 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.386081    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-dshm" (OuterVolumeSpecName: "dshm") pod "2e615d5a-3a2d-4eff-bb62-cbe692d154fe" (UID: "2e615d5a-3a2d-4eff-bb62-cbe692d154fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:02:58.386323 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.386297    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-kube-api-access-bvwnd" (OuterVolumeSpecName: "kube-api-access-bvwnd") pod "2e615d5a-3a2d-4eff-bb62-cbe692d154fe" (UID: "2e615d5a-3a2d-4eff-bb62-cbe692d154fe"). InnerVolumeSpecName "kube-api-access-bvwnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:58.485068 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.485033    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-dshm\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:58.485068 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.485063    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvwnd\" (UniqueName: \"kubernetes.io/projected/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-kube-api-access-bvwnd\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:58.485068 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.485077    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-model-cache\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:58.485315 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.485086    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-home\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:58.485315 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.485095    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e615d5a-3a2d-4eff-bb62-cbe692d154fe-tls-certs\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\""
Jul 23 17:02:58.697586 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.697550    2582 generic.go:356] "Generic (PLEG): container finished" podID="2e615d5a-3a2d-4eff-bb62-cbe692d154fe" containerID="835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352" exitCode=0
Jul 23 17:02:58.697586 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.697592    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"
Jul 23 17:02:58.697867 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.697643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc" event={"ID":"2e615d5a-3a2d-4eff-bb62-cbe692d154fe","Type":"ContainerDied","Data":"835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352"}
Jul 23 17:02:58.697867 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.697697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc" event={"ID":"2e615d5a-3a2d-4eff-bb62-cbe692d154fe","Type":"ContainerDied","Data":"378dfff4b237949fc26861a354cdfa5fe7966120b694c46f1bfac575d99bc010"}
Jul 23 17:02:58.697867 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.697720    2582 scope.go:117] "RemoveContainer" containerID="835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352"
Jul 23 17:02:58.706880 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.706827    2582 scope.go:117] "RemoveContainer" containerID="835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352"
Jul 23 17:02:58.707182 ip-10-0-131-182 kubenswrapper[2582]: E0723 17:02:58.707161    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352\": container with ID starting with 835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352 not found: ID does not exist" containerID="835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352"
Jul 23 17:02:58.707241 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.707191    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352"} err="failed to get container status \"835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352\": rpc error: code = NotFound desc = could not find container \"835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352\": container with ID starting with 835211de573449adea728fa7d85fc675e877665491449439e44e20cec2db0352 not found: ID does not exist"
Jul 23 17:02:58.719208 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.719179    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"]
Jul 23 17:02:58.722904 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:58.722878    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6a0c6b/rate-test-model-6a0c6b-kserve-5955bb64bc-qv6kc"]
Jul 23 17:02:59.592570 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:59.592523    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e615d5a-3a2d-4eff-bb62-cbe692d154fe" path="/var/lib/kubelet/pods/2e615d5a-3a2d-4eff-bb62-cbe692d154fe/volumes"
Jul 23 17:02:59.595071 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:02:59.593127    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fcff789-7df3-4c80-a9fc-884b4ca49f42" path="/var/lib/kubelet/pods/3fcff789-7df3-4c80-a9fc-884b4ca49f42/volumes"
Jul 23 17:03:15.434743 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:15.434707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:03:37.939911 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:37.939877    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gcffz"]
Jul 23 17:03:53.412611 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:53.412579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vgtnp_768413ad-f9d1-453b-aefc-3e818f52a578/manager/0.log"
Jul 23 17:03:53.543813 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:53.543783    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-w5v46_bd3cd3fd-79c0-4590-8732-5f6aa0e7329d/manager/0.log"
Jul 23 17:03:54.329691 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:54.329663    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-w4x6h_fe9bc931-68fe-4b72-9394-9f63e9087f54/copy-manifests/0.log"
Jul 23 17:03:54.343609 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:54.343575    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-w4x6h_fe9bc931-68fe-4b72-9394-9f63e9087f54/manager/0.log"
Jul 23 17:03:56.784479 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:56.784441    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rh9wl_1e903b7e-6e6d-4fff-97da-f84b04dcb852/manager/0.log"
Jul 23 17:03:57.166182 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:57.166153    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ps54k_850ce2e2-7308-4723-b900-35faf1db21b5/registry-server/0.log"
Jul 23 17:03:57.299544 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:57.299508    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zfkdk_b41cb8e0-4ca1-4244-b482-ae8e01454557/manager/0.log"
Jul 23 17:03:57.421659 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:57.421588    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gcffz_01ccdf84-3213-41d2-9d2c-57c165a92054/limitador/0.log"
Jul 23 17:03:59.573375 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:59.573347    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4w6v2_62ef9974-f01f-4b9f-af91-9bcd2ab2d97e/main/0.log"
Jul 23 17:03:59.818061 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:03:59.818027    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-vl822_51157fa4-1d20-4d67-9cdd-62a707080f8d/main/0.log"
Jul 23 17:04:09.487250 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:09.487221    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5chr_6149737f-227d-43a9-aac4-488a39f01121/global-pull-secret-syncer/0.log"
Jul 23 17:04:09.689538 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:09.689507    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m2n84_67ffc890-e228-44a1-be71-13bf66940594/konnectivity-agent/0.log"
Jul 23 17:04:09.712911 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:09.712880    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-182.ec2.internal_285fdc3c55c4d1cf1192c9e1a0b3d059/haproxy/0.log"
Jul 23 17:04:14.958068 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:14.958030    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rh9wl_1e903b7e-6e6d-4fff-97da-f84b04dcb852/manager/0.log"
Jul 23 17:04:15.078643 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:15.078591    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ps54k_850ce2e2-7308-4723-b900-35faf1db21b5/registry-server/0.log"
Jul 23 17:04:15.232649 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:15.232565    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zfkdk_b41cb8e0-4ca1-4244-b482-ae8e01454557/manager/0.log"
Jul 23 17:04:15.274107 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:15.274078    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gcffz_01ccdf84-3213-41d2-9d2c-57c165a92054/limitador/0.log"
Jul 23 17:04:17.005938 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.005910    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/alertmanager/0.log"
Jul 23 17:04:17.035091 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.035066    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/config-reloader/0.log"
Jul 23 17:04:17.069657 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.069633    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/kube-rbac-proxy-web/0.log"
Jul 23 17:04:17.096357 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.096328    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/kube-rbac-proxy/0.log"
Jul 23 17:04:17.117716 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.117694    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/kube-rbac-proxy-metric/0.log"
Jul 23 17:04:17.144915 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.144887    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/prom-label-proxy/0.log"
Jul 23 17:04:17.170038 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.169959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2f27ecfc-8166-4f2b-9608-fc7ddaee83b8/init-config-reloader/0.log"
Jul 23 17:04:17.259376 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.259348    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gf9h7_9218daeb-5152-4277-8feb-f05b8e889c52/kube-state-metrics/0.log"
Jul 23 17:04:17.281879 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.281834    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gf9h7_9218daeb-5152-4277-8feb-f05b8e889c52/kube-rbac-proxy-main/0.log"
Jul 23 17:04:17.304530 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.304500    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gf9h7_9218daeb-5152-4277-8feb-f05b8e889c52/kube-rbac-proxy-self/0.log"
Jul 23 17:04:17.337141 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.337118    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59694fc5c-f8768_0cdc44ed-50f6-4a88-b007-69d791a80fcb/metrics-server/0.log"
Jul 23 17:04:17.497154 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.497129    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7w5x_8f1e39bd-d1a8-4b07-a428-2529fbe53fc5/node-exporter/0.log"
Jul 23 17:04:17.519816 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.519789    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7w5x_8f1e39bd-d1a8-4b07-a428-2529fbe53fc5/kube-rbac-proxy/0.log"
Jul 23 17:04:17.541043 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.541016    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7w5x_8f1e39bd-d1a8-4b07-a428-2529fbe53fc5/init-textfile/0.log"
Jul 23 17:04:17.643564 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.643534    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-9xtx9_b02463ab-3c74-40ba-9d65-8cdeb9aef86c/kube-rbac-proxy-main/0.log"
Jul 23 17:04:17.666735 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.666705    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-9xtx9_b02463ab-3c74-40ba-9d65-8cdeb9aef86c/kube-rbac-proxy-self/0.log"
Jul 23 17:04:17.691087 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.691062    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-9xtx9_b02463ab-3c74-40ba-9d65-8cdeb9aef86c/openshift-state-metrics/0.log"
Jul 23 17:04:17.729655 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.729626    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/prometheus/0.log"
Jul 23 17:04:17.753737 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.753666    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/config-reloader/0.log"
Jul 23 17:04:17.780421 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.780394    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/thanos-sidecar/0.log"
Jul 23 17:04:17.806425 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.806390    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/kube-rbac-proxy-web/0.log"
Jul 23 17:04:17.832330 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.832304    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/kube-rbac-proxy/0.log"
Jul 23 17:04:17.857109 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.857082    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/kube-rbac-proxy-thanos/0.log"
Jul 23 17:04:17.880880 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.880826    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0ca5ff64-eb78-40fa-ad1e-16238024bafc/init-config-reloader/0.log"
Jul 23 17:04:17.978768 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:17.978735    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-jcfl9_715ce523-5644-471c-8652-e38e06ea8064/prometheus-operator-admission-webhook/0.log"
Jul 23 17:04:19.646433 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646394    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"]
Jul 23 17:04:19.646815 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646782    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fcff789-7df3-4c80-a9fc-884b4ca49f42" containerName="main"
Jul 23 17:04:19.646815 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646794    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fcff789-7df3-4c80-a9fc-884b4ca49f42" containerName="main"
Jul 23 17:04:19.646815 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646815    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e615d5a-3a2d-4eff-bb62-cbe692d154fe" containerName="main"
Jul 23 17:04:19.646957 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646822    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e615d5a-3a2d-4eff-bb62-cbe692d154fe" containerName="main"
Jul 23 17:04:19.646957 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646908    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fcff789-7df3-4c80-a9fc-884b4ca49f42" containerName="main"
Jul 23 17:04:19.646957 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.646916    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e615d5a-3a2d-4eff-bb62-cbe692d154fe" containerName="main"
Jul 23 17:04:19.649394 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.649374    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.652069 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.652045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wvj2n\"/\"default-dockercfg-9xm84\""
Jul 23 17:04:19.652069 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.652063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvj2n\"/\"openshift-service-ca.crt\""
Jul 23 17:04:19.652259 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.652086    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvj2n\"/\"kube-root-ca.crt\""
Jul 23 17:04:19.659138 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.659113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"]
Jul 23 17:04:19.747991 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.747954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-proc\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.747991 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.747991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwnjn\" (UniqueName: \"kubernetes.io/projected/c127f65a-2ca2-4a0e-afef-84f8639e74ed-kube-api-access-qwnjn\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.748235 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.748016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-sys\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.748235 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.748033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-lib-modules\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.748235 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.748122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-podres\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849274 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-proc\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849274 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwnjn\" (UniqueName: \"kubernetes.io/projected/c127f65a-2ca2-4a0e-afef-84f8639e74ed-kube-api-access-qwnjn\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849530 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-sys\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849530 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-sys\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849530 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-proc\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849530 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-lib-modules\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849530 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-podres\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849733 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849562    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-lib-modules\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.849733 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.849567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c127f65a-2ca2-4a0e-afef-84f8639e74ed-podres\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.858483 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.858459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwnjn\" (UniqueName: \"kubernetes.io/projected/c127f65a-2ca2-4a0e-afef-84f8639e74ed-kube-api-access-qwnjn\") pod \"perf-node-gather-daemonset-whcdv\" (UID: \"c127f65a-2ca2-4a0e-afef-84f8639e74ed\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:19.961924 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:19.961816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:20.091286 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:20.091259    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"]
Jul 23 17:04:20.094117 ip-10-0-131-182 kubenswrapper[2582]: W0723 17:04:20.094090    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc127f65a_2ca2_4a0e_afef_84f8639e74ed.slice/crio-5bb9d7c8731e1bc1688d096a49c5a48909bb8d900615bc79705ed66989397b73 WatchSource:0}: Error finding container 5bb9d7c8731e1bc1688d096a49c5a48909bb8d900615bc79705ed66989397b73: Status 404 returned error can't find the container with id 5bb9d7c8731e1bc1688d096a49c5a48909bb8d900615bc79705ed66989397b73
Jul 23 17:04:20.621286 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:20.621258    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c745548d7-c7r4r_9c30b60b-b733-4c09-a01a-f8c5dde976b6/console/0.log"
Jul 23 17:04:21.085779 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:21.085687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv" event={"ID":"c127f65a-2ca2-4a0e-afef-84f8639e74ed","Type":"ContainerStarted","Data":"9699c96fe824c6afe8f1e6154f7d078a17a5e9b8e0be613ad0574725bfaf1bcd"}
Jul 23 17:04:21.085779 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:21.085749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv" event={"ID":"c127f65a-2ca2-4a0e-afef-84f8639e74ed","Type":"ContainerStarted","Data":"5bb9d7c8731e1bc1688d096a49c5a48909bb8d900615bc79705ed66989397b73"}
Jul 23 17:04:21.085779 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:21.085778    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:21.104343 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:21.104294    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv" podStartSLOduration=2.104278943 podStartE2EDuration="2.104278943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:04:21.103035874 +0000 UTC m=+2914.508403132" watchObservedRunningTime="2026-07-23 17:04:21.104278943 +0000 UTC m=+2914.509646200"
Jul 23 17:04:22.209398 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:22.209370    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22wx7_05fb1af8-d1fb-4f0d-9415-f374a38014ef/dns/0.log"
Jul 23 17:04:22.230797 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:22.230768    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22wx7_05fb1af8-d1fb-4f0d-9415-f374a38014ef/kube-rbac-proxy/0.log"
Jul 23 17:04:22.358245 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:22.358215    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9ptqc_8fbec0b4-b5c3-406f-9ef2-50ca8aaa26b5/dns-node-resolver/0.log"
Jul 23 17:04:22.990994 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:22.990959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vq7nc_8d3666bc-4c89-4005-8001-76d81a38f6af/node-ca/0.log"
Jul 23 17:04:24.969071 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:24.969043    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qwxq9_15b44d0b-8589-4a22-a5d3-bfba6a90d154/serve-healthcheck-canary/0.log"
Jul 23 17:04:25.632178 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:25.632153    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r96wn_28aabef2-7fd0-4f52-bcdb-d468b5bb4c33/kube-rbac-proxy/0.log"
Jul 23 17:04:25.655063 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:25.655028    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r96wn_28aabef2-7fd0-4f52-bcdb-d468b5bb4c33/exporter/0.log"
Jul 23 17:04:25.679141 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:25.679110    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r96wn_28aabef2-7fd0-4f52-bcdb-d468b5bb4c33/extractor/0.log"
Jul 23 17:04:27.101515 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:27.101488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-whcdv"
Jul 23 17:04:27.775983 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:27.775954    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vgtnp_768413ad-f9d1-453b-aefc-3e818f52a578/manager/0.log"
Jul 23 17:04:27.945207 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:27.945178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-w5v46_bd3cd3fd-79c0-4590-8732-5f6aa0e7329d/manager/0.log"
Jul 23 17:04:28.544908 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:28.544827    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-w4x6h_fe9bc931-68fe-4b72-9394-9f63e9087f54/manager/0.log"
Jul 23 17:04:28.567996 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:28.567968    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-w4x6h_fe9bc931-68fe-4b72-9394-9f63e9087f54/copy-manifests/0.log"
Jul 23 17:04:30.038892 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:30.038835    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-598cd96689-xvcx4_0b64b3f5-40e3-4c0d-9974-bb25f2575b9c/manager/0.log"
Jul 23 17:04:36.725464 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:36.725435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7jljb_b2cb6d52-21c8-4041-b8d9-c627b74bd57a/kube-multus/0.log"
Jul 23 17:04:36.934406 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:36.934371    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/kube-multus-additional-cni-plugins/0.log"
Jul 23 17:04:36.963750 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:36.963718    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/egress-router-binary-copy/0.log"
Jul 23 17:04:36.996690 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:36.996609    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/cni-plugins/0.log"
Jul 23 17:04:37.033701 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:37.033677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/bond-cni-plugin/0.log"
Jul 23 17:04:37.064052 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:37.064025    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/routeoverride-cni/0.log"
Jul 23 17:04:37.091807 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:37.091781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/whereabouts-cni-bincopy/0.log"
Jul 23 17:04:37.114873 ip-10-0-131-182 kubenswrapper[2582]: I0723 17:04:37.114823    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hscb4_6b1c9ac9-9e99-4c0b-9008-349cac0fdef4/whereabouts-cni/0.log"