Jul 23 18:02:17.470678 ip-10-0-137-162 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.883086    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891757    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891770    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891773    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891776    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891779    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891782    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891784    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:17.892076 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891788    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891791    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891793    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891796    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891799    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891801    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891804    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891806    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891809    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891811    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891814    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891816    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891823    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891826    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891828    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891831    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891834    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891836    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891839    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891841    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:17.895610 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891844    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891847    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891851    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891853    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891856    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891858    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891861    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891864    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891866    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891869    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891873    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891877    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891880    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891883    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891886    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891888    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891891    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891894    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891897    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891901    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:17.907668 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891903    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891906    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891908    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891916    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891919    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891921    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891924    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891926    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891929    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891932    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891934    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891937    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891940    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891942    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891945    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891948    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891950    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891953    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891956    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891959    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:17.909917 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891961    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891964    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891968    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891972    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891974    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891977    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891980    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891983    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891987    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891989    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891992    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891994    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891997    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.891999    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892002    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892004    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892013    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892016    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892018    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:17.947808 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892021    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892023    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892026    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892028    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892031    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892034    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892036    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892039    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892042    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892044    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892047    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892050    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892052    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892805    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892812    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892815    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892817    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892820    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892823    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:17.950214 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892825    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892829    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892833    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892836    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892840    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892843    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892846    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892849    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892852    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892855    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892858    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892867    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892870    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892873    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892876    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892879    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892881    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892884    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892887    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:18.017837 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892891    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:17.961215 ip-10-0-137-162 systemd[1]: Started Kubernetes Kubelet.
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892895    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892898    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892901    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892904    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892907    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892910    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892912    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892915    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892917    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892920    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892922    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892925    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892927    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892929    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892932    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892935    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892937    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892940    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892942    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:18.021606 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892945    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892947    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892950    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892952    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892955    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892963    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892965    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892968    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892970    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892973    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892975    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892981    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892983    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892986    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892988    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892991    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892993    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892996    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.892999    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893001    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:18.222493 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893004    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893006    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893009    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893011    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893013    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893016    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893018    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893021    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893023    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893026    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893028    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893031    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893033    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893036    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893038    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893041    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893043    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893045    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893054    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893058    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:18.224071 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893061    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893063    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893066    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893070    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893073    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893075    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893078    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893081    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893083    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893085    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893088    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893091    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893093    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893096    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893477    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893483    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893486    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893489    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893491    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893494    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:18.225138 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893496    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893499    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893501    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893504    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893507    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893509    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893512    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893514    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893517    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893520    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893523    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893525    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893528    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893530    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893533    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893538    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893540    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893543    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893546    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893548    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:18.227555 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893551    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893553    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893556    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893558    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893561    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893563    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893566    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893569    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893571    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893574    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893576    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893579    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893581    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893583    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893586    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893588    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893591    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893593    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893597    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:18.228321 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893601    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893604    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893607    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893609    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893612    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893615    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893617    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893620    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893624    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893626    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893629    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893631    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893634    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893636    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893639    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893643    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893646    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893648    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893651    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:18.229905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893653    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893656    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893660    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893662    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893665    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893668    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893670    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893673    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893675    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893678    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893680    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893683    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893685    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893688    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893694    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893697    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893700    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893702    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893706    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893708    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:18.230697 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893711    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893715    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893717    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893719    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893722    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893725    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893727    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893730    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893732    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893735    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893737    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893740    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893742    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893745    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.893749    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893812    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893819    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893825    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893829    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893833    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893836    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 18:02:18.231868 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893840    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893844    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893847    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893850    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893853    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893856    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893859    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893862    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893865    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893868    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893872    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893875    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893881    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893883    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893886    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893889    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893892    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893896    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893899    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893902    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893905    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893908    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893911    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893914    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 18:02:18.233896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893917    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893922    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893925    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893929    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893931    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893934    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893937    2578 flags.go:64] FLAG: --enable-server="true"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893940    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893944    2578 flags.go:64] FLAG: --event-burst="100"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893947    2578 flags.go:64] FLAG: --event-qps="50"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893950    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893953    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893956    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893960    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893963    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893966    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893968    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893971    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893974    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893977    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893982    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893985    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893988    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893990    2578 flags.go:64] FLAG: --feature-gates=""
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893994    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 18:02:18.234584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.893997    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894000    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894003    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894006    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894009    2578 flags.go:64] FLAG: --help="false"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894012    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894015    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894018    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894022    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894025    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894029    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894031    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894035    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894037    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894040    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894043    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894046    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894049    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894052    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894054    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894057    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894060    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894062    2578 flags.go:64] FLAG: --lock-file=""
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894065    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 18:02:18.235253 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894068    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894071    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894076    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894080    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894083    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894085    2578 flags.go:64] FLAG: --logging-format="text"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894088    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894092    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894094    2578 flags.go:64] FLAG: --manifest-url=""
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894097    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894101    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894104    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894108    2578 flags.go:64] FLAG: --max-pods="110"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894110    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894113    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894116    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894121    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894124    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894127    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894130    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894136    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894139    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894142    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 18:02:18.235904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894145    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894148    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894153    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894156    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894159    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894162    2578 flags.go:64] FLAG: --port="10250"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894164    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894167    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc978af8c06ac283"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894170    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894173    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894176    2578 flags.go:64] FLAG: --register-node="true"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894179    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894183    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894187    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894190    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894193    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894196    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894199    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894202    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894205    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894208    2578 flags.go:64] FLAG: --runonce="false"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894210    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894213    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894216    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894219    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 18:02:18.236522 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894223    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894226    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894229    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894231    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894234    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894237    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894240    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894242    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894245    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894248    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894250    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894255    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894258    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894261    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894265    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894268    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894270    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894273    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894276    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894279    2578 flags.go:64] FLAG: --v="2"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894289    2578 flags.go:64] FLAG: --version="false"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894294    2578 flags.go:64] FLAG: --vmodule=""
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894297    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894301    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 18:02:18.237131 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894421    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894425    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894428    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894431    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894434    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894436    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894439    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894442    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894445    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894448    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894451    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894453    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894456    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894458    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894461    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894464    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894466    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894469    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894471    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894474    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:18.237757 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894477    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894480    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894482    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894485    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894488    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894491    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894493    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894496    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894500    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894503    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894506    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894509    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894511    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894514    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894516    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894519    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894522    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894524    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894526    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894530    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:18.238243 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894534    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894536    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894539    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894541    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894544    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894546    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894552    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894555    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894559    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894563    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894566    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894568    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894571    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894574    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894576    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894579    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894582    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894585    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894588    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894591    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:18.238742 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894595    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894598    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894601    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894604    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894606    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894609    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894611    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894614    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894617    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894620    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894622    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894625    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894628    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894631    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894633    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894636    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894638    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894641    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894643    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:18.239221 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894646    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894648    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894651    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894653    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894656    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894659    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894661    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894664    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894666    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894669    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894672    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894676    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894679    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894683    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894686    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894688    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894691    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894694    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894697    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:18.239704 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.894699    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.894705    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.904036    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.904051    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.904707    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.904718    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904772    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904777    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904781    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904784    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904787    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904790    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904792    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904796    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904800    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:18.240172 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904803    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904806    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904809    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904812    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904815    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904817    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904820    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904823    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904826    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904829    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904832    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904835    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904838    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904840    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904843    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904846    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904849    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904852    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904854    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904857    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:18.240561 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904860    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904863    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904865    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904868    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904870    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904873    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904875    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904878    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904880    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904883    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904886    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904888    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904891    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904894    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904896    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904899    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904901    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904904    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904906    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904909    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:18.241067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904911    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904914    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904920    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904922    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904925    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904928    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904930    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904933    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904936    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904938    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904941    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904943    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904946    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904948    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904951    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904954    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904957    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904959    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904962    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904964    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:18.241600 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904967    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904969    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904972    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904975    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904977    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904980    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904984    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904987    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904990    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904992    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904995    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.904998    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905000    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905003    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905007    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905012    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905014    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905017    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905020    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:18.242098 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905022    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905025    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905028    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905031    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905033    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905035    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905038    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905040    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905043    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905047    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905050    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.905055    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905157    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905161    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:18.242580 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905164    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905166    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905169    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905171    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905174    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905177    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905179    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905182    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905185    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905187    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905190    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905192    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905195    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905197    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905202    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905205    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905208    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905211    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905213    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905216    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:18.242921 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905219    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905222    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905225    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905227    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905230    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905233    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905235    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905238    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905240    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905244    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905248    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905251    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905254    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905257    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905259    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905262    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905264    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905267    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905269    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:18.243400 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905272    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905274    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905277    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905279    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905282    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905284    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905287    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905291    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905294    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905296    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905301    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905304    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905306    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905310    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905312    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905316    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905319    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905322    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905324    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905327    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:18.243875 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905329    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905332    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905335    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905338    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905342    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905344    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905347    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905350    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905353    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905355    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905358    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905360    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905363    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905366    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905368    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905370    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905373    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905376    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905378    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905383    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:18.244348 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905385    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905388    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905391    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905394    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905396    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905399    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905401    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905425    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905431    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905434    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905439    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905442    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905446    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905449    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905451    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905454    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905456    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:18.244850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:17.905459    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.905464    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.905555    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.907489    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.908891    2578 server.go:1019] "Starting client certificate rotation"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.908988    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.909664    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.911174    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.916199    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.929256    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.931736    2578 log.go:25] "Validated CRI v1 image API"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.933250    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 18:02:18.245257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.935966    2578 fs.go:135] Filesystem UUIDs: map[73fc0b94-c602-4c78-ba4e-6049c96ba5e9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a7cf4126-408a-482d-8219-4b0d6f24023a:/dev/nvme0n1p3]
Jul 23 18:02:18.245573 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.935980    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.940864    2578 manager.go:216] Machine: {Timestamp:2026-07-23 18:02:17.939704895 +0000 UTC m=+0.352407675 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088320 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1d9e063f5e55fdb4a1cb9df858c9 SystemUUID:ec2e1d9e-063f-5e55-fdb4-a1cb9df858c9 BootID:1a83d2a8-6ab4-470a-9766-dc17ceaef7b7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:92:b3:93:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:92:b3:93:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:42:52:3b:35:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.940956    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.941022    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.941387    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.944061    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.944090    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 18:02:18.245604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.944763    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.944774    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.944781    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.945330    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.946477    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949659    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949767    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949792    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949801    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949812    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949821    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.949834    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.950127    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.950158    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.953003    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.954733    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.954759    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956426    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956441    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956447    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956454    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956462    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956468    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956475    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956480    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956487    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956492    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956501    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.956507    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.957435    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.957442    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.960471    2578 server.go:1268] "Started kubelet"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.960555    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.970332    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.970525    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.971111    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.971113    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 18:02:18.245818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.971649    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.974478    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-162.ec2.internal.18c4fd30b3af8f7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-162.ec2.internal,UID:ip-10-0-137-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-162.ec2.internal,},FirstTimestamp:2026-07-23 18:02:17.960443772 +0000 UTC m=+0.373146551,LastTimestamp:2026-07-23 18:02:17.960443772 +0000 UTC m=+0.373146551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-162.ec2.internal,}"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.975581    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.979209    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.982623    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.987467    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.987756    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.988496    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.988696    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.988708    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.988812    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.988818    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.989161    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992388    2578 factory.go:55] Registering systemd factory
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992442    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992733    2578 factory.go:153] Registering CRI-O factory
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992753    2578 factory.go:223] Registration of the crio container factory successfully
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992817    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992840    2578 factory.go:103] Registering Raw factory
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.992859    2578 manager.go:1196] Started watching for new ooms in manager
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:17.993464    2578 manager.go:349] Starting recovery of all containers
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.996103    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:17.996172    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.006551    2578 manager.go:354] Recovery completed
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.008260    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df7dg"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.008272    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-df7dg"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.010328    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.011933    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.011952    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.011962    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013041    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013046    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013051    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 18:02:18.246769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013070    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013650    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013669    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.013681    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.014146    2578 policy_none.go:49] "None policy: Start"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.014161    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.014175    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.014247    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-162.ec2.internal.18c4fd30b6c163ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-162.ec2.internal,UID:ip-10-0-137-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-162.ec2.internal,},FirstTimestamp:2026-07-23 18:02:18.011943866 +0000 UTC m=+0.424646645,LastTimestamp:2026-07-23 18:02:18.011943866 +0000 UTC m=+0.424646645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-162.ec2.internal,}"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.015969    2578 policy_none.go:47] "Start"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063292    2578 manager.go:337] "Starting Device Plugin manager"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.063329    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063340    2578 server.go:87] "Starting device plugin registration server"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063615    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063628    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063750    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063896    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.063909    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.064634    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.064703    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.114145    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.115284    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.115316    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.115335    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.115364    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.118422    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.164700    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.165509    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.165538    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.165558    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.165592    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.173837    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.173854    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-162.ec2.internal\": node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.247624 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.204013    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.215808    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"]
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.215892    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.216746    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.216774    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.216788    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.218290    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.218420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.218453    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.219374    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.219427    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.219441    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.219448    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.219471    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.219487    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.220770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.220796    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.221441    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.221462    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:18.248389 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.221470    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:18.287958 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.287939    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-162.ec2.internal\" not found" node="ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.289998 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.289981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15ea91eb67e7eb0dff38d12d61c652ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"15ea91eb67e7eb0dff38d12d61c652ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.290060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.290008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15ea91eb67e7eb0dff38d12d61c652ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"15ea91eb67e7eb0dff38d12d61c652ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.290060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.290035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f70772c471111bb88b9c0b05ceea9c74-config\") pod \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" (UID: \"f70772c471111bb88b9c0b05ceea9c74\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.293616 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.293597    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-162.ec2.internal\" not found" node="ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.304426 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.304396    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.390591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.390570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15ea91eb67e7eb0dff38d12d61c652ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"15ea91eb67e7eb0dff38d12d61c652ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.390723 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.390597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f70772c471111bb88b9c0b05ceea9c74-config\") pod \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" (UID: \"f70772c471111bb88b9c0b05ceea9c74\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.390723 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.390615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15ea91eb67e7eb0dff38d12d61c652ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"15ea91eb67e7eb0dff38d12d61c652ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.390723 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.390651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/15ea91eb67e7eb0dff38d12d61c652ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"15ea91eb67e7eb0dff38d12d61c652ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.390723 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.390684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f70772c471111bb88b9c0b05ceea9c74-config\") pod \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" (UID: \"f70772c471111bb88b9c0b05ceea9c74\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.390723 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.390686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15ea91eb67e7eb0dff38d12d61c652ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"15ea91eb67e7eb0dff38d12d61c652ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.404685 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.404658    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.505438 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.505364    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.590679 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.590658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.596834 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.596813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.606312 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.606294    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.706793 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.706764    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 23 18:02:18.796842 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.796820    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:18.889537 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.889517    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.906070 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.906049    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:02:18.908045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.908033    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.908153 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.908139    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 18:02:18.908267 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.908228    2578 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a763fbb5d8bcf44c0b5a08b95ac6b7d4-15af550afb3530f7.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.137.162:56340->100.56.89.178:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:18.908324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.908272    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 18:02:18.908324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.908304    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 18:02:18.950193 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.950173    2578 apiserver.go:52] "Watching apiserver"
Jul 23 18:02:18.970095 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.970075    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 18:02:18.972515 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.972495    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-vbmxj","openshift-multus/network-metrics-daemon-9stdm","openshift-ovn-kubernetes/ovnkube-node-xj4kk","kube-system/global-pull-secret-syncer-mxhw6","kube-system/konnectivity-agent-vxkzb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9","openshift-cluster-node-tuning-operator/tuned-pv6k8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal","openshift-multus/multus-94mlk","openshift-network-diagnostics/network-check-target-qms52","openshift-network-operator/iptables-alerter-wbqg5","openshift-dns/node-resolver-6m8fr","openshift-image-registry/node-ca-kzc8d"]
Jul 23 18:02:18.973790 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.973762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:18.973858 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.973842    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:18.975173 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.975155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:18.975253 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.975209    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:18.976220 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.976204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.977342 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.977323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.978889 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.978873    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.979079 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.979061    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5864v\""
Jul 23 18:02:18.979277 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.979263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 18:02:18.979351 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.979264    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 18:02:18.979594 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.979579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.980170 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.980278 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980181    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 18:02:18.980278 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980187    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 18:02:18.980490 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.980588 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980511    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zvmtx\""
Jul 23 18:02:18.980588 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980547    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.980684 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 18:02:18.980930 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.980913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.981994 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.981978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.983090 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.982584    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8xqv\""
Jul 23 18:02:18.983090 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.982680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.983225 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.983147    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.984202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.983757    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.984202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.983992    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.984202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.984185    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 18:02:18.984592 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.984549    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 18:02:18.984864 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.984847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2dtxg\""
Jul 23 18:02:18.985338 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.984948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:18.985338 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.984974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c6rhp\""
Jul 23 18:02:18.985338 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.985141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:18.986048 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.986033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 18:02:18.986104 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.986048    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 18:02:18.987058 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.987040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:18.987135 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:18.987123    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:18.987630 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.987615    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.987830 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.987816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.987901 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.987888    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 18:02:18.988078 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.988062    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.988293 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.988277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:18.988368 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.988342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gcpcl\""
Jul 23 18:02:18.988368 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.988354    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5l8qc\""
Jul 23 18:02:18.988487 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.988356    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.988732 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.988718    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 18:02:18.989341 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.989327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:18.990207 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.990192    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 18:02:18.990768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.990752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-chwbz\""
Jul 23 18:02:18.990811 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.990773    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 18:02:18.990853 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.990813    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 18:02:18.992048 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.992032    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 18:02:18.992156 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.992055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9zv88\""
Jul 23 18:02:18.992156 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.992038    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:18.992156 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.992033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:18.994002 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.993975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-kubelet\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994067 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994067 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9db23c5-2cba-4d14-af46-7e2b369e166b-host-slash\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:18.994067 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-lib-modules\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.994231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-etc-kubernetes\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.994231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.994231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.994231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-cni-bin\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/696a2281-26ef-43ff-a78e-d02bab924388-tmp-dir\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:18.994231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhftm\" (UniqueName: \"kubernetes.io/projected/c9db23c5-2cba-4d14-af46-7e2b369e166b-kube-api-access-lhftm\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-socket-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-var-lib-kubelet\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-cnibin\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-dbus\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-sys\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e181d1e-e225-4818-b31f-54a17e681e93-etc-tuned\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-daemon-config\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw46v\" (UniqueName: \"kubernetes.io/projected/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-kube-api-access-hw46v\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.994497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-ovn\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovn-node-metrics-cert\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-registration-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-cnibin\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-systemd-units\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-run-netns\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcft8\" (UniqueName: \"kubernetes.io/projected/3e78ea65-2ea1-4995-b820-30839c2ad8fe-kube-api-access-tcft8\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9db23c5-2cba-4d14-af46-7e2b369e166b-iptables-alerter-script\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-modprobe-d\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-cni-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjsft\" (UniqueName: \"kubernetes.io/projected/5842ed4d-93da-42af-a368-eae65c64dc89-kube-api-access-gjsft\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:18.994803 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqr5\" (UniqueName: \"kubernetes.io/projected/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-kube-api-access-9sqr5\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-node-log\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-cni-netd\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovnkube-script-lib\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-system-cni-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-socket-dir-parent\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5842ed4d-93da-42af-a368-eae65c64dc89-host\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-cni-binary-copy\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-cni-multus\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.994993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e181d1e-e225-4818-b31f-54a17e681e93-tmp\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovnkube-config\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-sys-fs\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.995167 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-systemd\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-netns\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-kubelet\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-conf-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysctl-d\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785j7\" (UniqueName: \"kubernetes.io/projected/661fbde8-4014-4048-aa9d-751c9d24e4a3-kube-api-access-785j7\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5842ed4d-93da-42af-a368-eae65c64dc89-serviceca\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/696a2281-26ef-43ff-a78e-d02bab924388-hosts-file\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-kubelet-config\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-kubernetes\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-run\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-var-lib-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-log-socket\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.995712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-env-overrides\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-k8s-cni-cncf-io\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-multus-certs\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-etc-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrmr\" (UniqueName: \"kubernetes.io/projected/696a2281-26ef-43ff-a78e-d02bab924388-kube-api-access-vcrmr\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysconfig\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l74dv\" (UniqueName: \"kubernetes.io/projected/0e181d1e-e225-4818-b31f-54a17e681e93-kube-api-access-l74dv\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-cni-bin\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-os-release\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba8260da-1727-4036-9863-bf1197441f18-agent-certs\") pod \"konnectivity-agent-vxkzb\" (UID: \"ba8260da-1727-4036-9863-bf1197441f18\") " pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba8260da-1727-4036-9863-bf1197441f18-konnectivity-ca\") pod \"konnectivity-agent-vxkzb\" (UID: \"ba8260da-1727-4036-9863-bf1197441f18\") " pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:18.996133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5287d\" (UniqueName: \"kubernetes.io/projected/6907a410-2655-45db-9b61-d8d72c0cf8f6-kube-api-access-5287d\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysctl-conf\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-os-release\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-hostroot\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-system-cni-dir\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-device-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-slash\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-systemd\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:18.996558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.995937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-host\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:18.997739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.997722    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:18.999682 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:18.999664    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:02:19.012390 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.012338    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 17:57:18 +0000 UTC" deadline="2028-03-02 23:44:54.588012141 +0000 UTC"
Jul 23 18:02:19.012465 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.012392    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14117h42m35.57562418s"
Jul 23 18:02:19.024145 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.024127    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v55hl"
Jul 23 18:02:19.035140 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.035123    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v55hl"
Jul 23 18:02:19.096612 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-netns\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.096823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-kubelet\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.096823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-conf-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.096823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.096823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-netns\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.096823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-conf-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.096823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-kubelet\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.097169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysctl-d\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.097169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.097169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785j7\" (UniqueName: \"kubernetes.io/projected/661fbde8-4014-4048-aa9d-751c9d24e4a3-kube-api-access-785j7\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.097169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5842ed4d-93da-42af-a368-eae65c64dc89-serviceca\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.097169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.096926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/696a2281-26ef-43ff-a78e-d02bab924388-hosts-file\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.097438 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/696a2281-26ef-43ff-a78e-d02bab924388-hosts-file\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.097438 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysctl-d\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.097438 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-kubelet-config\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:19.097644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-kubernetes\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.097644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-run\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.097644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-kubernetes\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.097644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-kubelet-config\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:19.097644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-var-lib-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.097644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-log-socket\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.097975 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.097975 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.097755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-env-overrides\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5842ed4d-93da-42af-a368-eae65c64dc89-serviceca\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-var-lib-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-env-overrides\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-k8s-cni-cncf-io\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-run\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-log-socket\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-multus-certs\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-etc-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-k8s-cni-cncf-io\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrmr\" (UniqueName: \"kubernetes.io/projected/696a2281-26ef-43ff-a78e-d02bab924388-kube-api-access-vcrmr\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-etc-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysconfig\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l74dv\" (UniqueName: \"kubernetes.io/projected/0e181d1e-e225-4818-b31f-54a17e681e93-kube-api-access-l74dv\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-cni-bin\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-os-release\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba8260da-1727-4036-9863-bf1197441f18-agent-certs\") pod \"konnectivity-agent-vxkzb\" (UID: \"ba8260da-1727-4036-9863-bf1197441f18\") " pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.098750    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba8260da-1727-4036-9863-bf1197441f18-konnectivity-ca\") pod \"konnectivity-agent-vxkzb\" (UID: \"ba8260da-1727-4036-9863-bf1197441f18\") " pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5287d\" (UniqueName: \"kubernetes.io/projected/6907a410-2655-45db-9b61-d8d72c0cf8f6-kube-api-access-5287d\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.098883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysconfig\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.098851    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:19.598820539 +0000 UTC m=+2.011523326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-run-multus-certs\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-cni-bin\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysctl-conf\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.098997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-os-release\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-hostroot\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-system-cni-dir\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-device-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-sysctl-conf\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-system-cni-dir\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-device-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.099626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099574    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-hostroot\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-slash\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-systemd\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-host\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba8260da-1727-4036-9863-bf1197441f18-konnectivity-ca\") pod \"konnectivity-agent-vxkzb\" (UID: \"ba8260da-1727-4036-9863-bf1197441f18\") " pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-kubelet\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-os-release\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9db23c5-2cba-4d14-af46-7e2b369e166b-host-slash\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-lib-modules\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-etc-kubernetes\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-systemd\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-slash\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.100280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-etc-kubernetes\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-cni-bin\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/696a2281-26ef-43ff-a78e-d02bab924388-tmp-dir\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-kubelet\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhftm\" (UniqueName: \"kubernetes.io/projected/c9db23c5-2cba-4d14-af46-7e2b369e166b-kube-api-access-lhftm\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-lib-modules\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9db23c5-2cba-4d14-af46-7e2b369e166b-host-slash\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-cni-bin\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-socket-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-var-lib-kubelet\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-cnibin\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.101091 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-dbus\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-sys\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e181d1e-e225-4818-b31f-54a17e681e93-etc-tuned\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-daemon-config\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw46v\" (UniqueName: \"kubernetes.io/projected/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-kube-api-access-hw46v\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-ovn\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovn-node-metrics-cert\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-registration-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/661fbde8-4014-4048-aa9d-751c9d24e4a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.100996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-cnibin\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.101077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-cnibin\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.101157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/696a2281-26ef-43ff-a78e-d02bab924388-tmp-dir\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.101212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-openvswitch\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.101976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.101349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-host\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.099588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-os-release\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.101812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-run-ovn\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.101854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-cnibin\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-var-lib-kubelet\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-sys\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-dbus\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-registration-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-systemd-units\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-run-netns\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcft8\" (UniqueName: \"kubernetes.io/projected/3e78ea65-2ea1-4995-b820-30839c2ad8fe-kube-api-access-tcft8\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9db23c5-2cba-4d14-af46-7e2b369e166b-iptables-alerter-script\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-modprobe-d\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.102787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-cni-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjsft\" (UniqueName: \"kubernetes.io/projected/5842ed4d-93da-42af-a368-eae65c64dc89-kube-api-access-gjsft\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqr5\" (UniqueName: \"kubernetes.io/projected/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-kube-api-access-9sqr5\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-node-log\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-cni-netd\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovnkube-script-lib\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-system-cni-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-socket-dir-parent\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.102970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5842ed4d-93da-42af-a368-eae65c64dc89-host\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-cni-binary-copy\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-cni-multus\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e181d1e-e225-4818-b31f-54a17e681e93-tmp\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.103476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovnkube-config\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-sys-fs\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-systemd\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-systemd\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0e181d1e-e225-4818-b31f-54a17e681e93-etc-modprobe-d\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-cni-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.103769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-daemon-config\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.103797    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.103867    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:02:19.603846389 +0000 UTC m=+2.016549159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-node-log\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.104233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-cni-netd\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba8260da-1727-4036-9863-bf1197441f18-agent-certs\") pod \"konnectivity-agent-vxkzb\" (UID: \"ba8260da-1727-4036-9863-bf1197441f18\") " pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104336    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9db23c5-2cba-4d14-af46-7e2b369e166b-iptables-alerter-script\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-systemd-units\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104403    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e78ea65-2ea1-4995-b820-30839c2ad8fe-host-run-netns\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-socket-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovnkube-script-lib\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.104800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-multus-socket-dir-parent\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.105159 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-system-cni-dir\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.105159 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.104998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-cni-binary-copy\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.105159 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.105024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/661fbde8-4014-4048-aa9d-751c9d24e4a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.105159 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.105093    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5842ed4d-93da-42af-a368-eae65c64dc89-host\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.105159 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.105155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.105422 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.105202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-host-var-lib-cni-multus\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.105422 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.105262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6907a410-2655-45db-9b61-d8d72c0cf8f6-sys-fs\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.105422 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.105266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovnkube-config\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.107164 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.107114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e78ea65-2ea1-4995-b820-30839c2ad8fe-ovn-node-metrics-cert\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.107286 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.107185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e181d1e-e225-4818-b31f-54a17e681e93-tmp\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.108029 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.108006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0e181d1e-e225-4818-b31f-54a17e681e93-etc-tuned\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.110474 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.110403    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:19.110474 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.110430    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:19.110474 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.110445    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:19.110754 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.110560    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:19.610540824 +0000 UTC m=+2.023243622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:19.111337 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.111317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrmr\" (UniqueName: \"kubernetes.io/projected/696a2281-26ef-43ff-a78e-d02bab924388-kube-api-access-vcrmr\") pod \"node-resolver-6m8fr\" (UID: \"696a2281-26ef-43ff-a78e-d02bab924388\") " pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.111682 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.111624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-785j7\" (UniqueName: \"kubernetes.io/projected/661fbde8-4014-4048-aa9d-751c9d24e4a3-kube-api-access-785j7\") pod \"multus-additional-cni-plugins-vbmxj\" (UID: \"661fbde8-4014-4048-aa9d-751c9d24e4a3\") " pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.113792 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.113580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhftm\" (UniqueName: \"kubernetes.io/projected/c9db23c5-2cba-4d14-af46-7e2b369e166b-kube-api-access-lhftm\") pod \"iptables-alerter-wbqg5\" (UID: \"c9db23c5-2cba-4d14-af46-7e2b369e166b\") " pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.113792 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.113580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw46v\" (UniqueName: \"kubernetes.io/projected/e1b23a98-57c4-4096-ad70-8237c8c8b2a1-kube-api-access-hw46v\") pod \"multus-94mlk\" (UID: \"e1b23a98-57c4-4096-ad70-8237c8c8b2a1\") " pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.114146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.114012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5287d\" (UniqueName: \"kubernetes.io/projected/6907a410-2655-45db-9b61-d8d72c0cf8f6-kube-api-access-5287d\") pod \"aws-ebs-csi-driver-node-nlfc9\" (UID: \"6907a410-2655-45db-9b61-d8d72c0cf8f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.114771 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.114745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcft8\" (UniqueName: \"kubernetes.io/projected/3e78ea65-2ea1-4995-b820-30839c2ad8fe-kube-api-access-tcft8\") pod \"ovnkube-node-xj4kk\" (UID: \"3e78ea65-2ea1-4995-b820-30839c2ad8fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.116026 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.115995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l74dv\" (UniqueName: \"kubernetes.io/projected/0e181d1e-e225-4818-b31f-54a17e681e93-kube-api-access-l74dv\") pod \"tuned-pv6k8\" (UID: \"0e181d1e-e225-4818-b31f-54a17e681e93\") " pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.116139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.116121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjsft\" (UniqueName: \"kubernetes.io/projected/5842ed4d-93da-42af-a368-eae65c64dc89-kube-api-access-gjsft\") pod \"node-ca-kzc8d\" (UID: \"5842ed4d-93da-42af-a368-eae65c64dc89\") " pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.116284 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.116262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqr5\" (UniqueName: \"kubernetes.io/projected/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-kube-api-access-9sqr5\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:19.127344 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.127323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:19.134524 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.134493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wbqg5"
Jul 23 18:02:19.193270 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.193245    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70772c471111bb88b9c0b05ceea9c74.slice/crio-8656cab1725e06c61bbbb0215d70c6e69c15b2b4825cb9daab86788df987dbb5 WatchSource:0}: Error finding container 8656cab1725e06c61bbbb0215d70c6e69c15b2b4825cb9daab86788df987dbb5: Status 404 returned error can't find the container with id 8656cab1725e06c61bbbb0215d70c6e69c15b2b4825cb9daab86788df987dbb5
Jul 23 18:02:19.193470 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.193450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ea91eb67e7eb0dff38d12d61c652ba.slice/crio-0a442e42022bcc3fec88793b9b891a68bfd5e366598048c307d95fb2dc9e85bc WatchSource:0}: Error finding container 0a442e42022bcc3fec88793b9b891a68bfd5e366598048c307d95fb2dc9e85bc: Status 404 returned error can't find the container with id 0a442e42022bcc3fec88793b9b891a68bfd5e366598048c307d95fb2dc9e85bc
Jul 23 18:02:19.197162 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.197148    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:02:19.297601 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.297576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:19.305079 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.305051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e78ea65_2ea1_4995_b820_30839c2ad8fe.slice/crio-dec657f5394b396856547c6624e52dd50b91e23eaadc99725c733aae649dc97b WatchSource:0}: Error finding container dec657f5394b396856547c6624e52dd50b91e23eaadc99725c733aae649dc97b: Status 404 returned error can't find the container with id dec657f5394b396856547c6624e52dd50b91e23eaadc99725c733aae649dc97b
Jul 23 18:02:19.313690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.313643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9"
Jul 23 18:02:19.320773 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.320751    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6907a410_2655_45db_9b61_d8d72c0cf8f6.slice/crio-04de97b5e6a9f45275e03089a3055dff6257d1ea0a95a91c70e2dc9a3108f2c8 WatchSource:0}: Error finding container 04de97b5e6a9f45275e03089a3055dff6257d1ea0a95a91c70e2dc9a3108f2c8: Status 404 returned error can't find the container with id 04de97b5e6a9f45275e03089a3055dff6257d1ea0a95a91c70e2dc9a3108f2c8
Jul 23 18:02:19.330844 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.330826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pv6k8"
Jul 23 18:02:19.337303 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.337279    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e181d1e_e225_4818_b31f_54a17e681e93.slice/crio-c6accd4415826aacab58f169038c57d985c01322dc26797c908cfb7ef4d8e7fb WatchSource:0}: Error finding container c6accd4415826aacab58f169038c57d985c01322dc26797c908cfb7ef4d8e7fb: Status 404 returned error can't find the container with id c6accd4415826aacab58f169038c57d985c01322dc26797c908cfb7ef4d8e7fb
Jul 23 18:02:19.343228 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.343210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-94mlk"
Jul 23 18:02:19.349962 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.349943    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b23a98_57c4_4096_ad70_8237c8c8b2a1.slice/crio-f949daefa52f4cf64d62145fc478983d6a426b0a61e6670f89cab2743678d880 WatchSource:0}: Error finding container f949daefa52f4cf64d62145fc478983d6a426b0a61e6670f89cab2743678d880: Status 404 returned error can't find the container with id f949daefa52f4cf64d62145fc478983d6a426b0a61e6670f89cab2743678d880
Jul 23 18:02:19.360777 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.360758    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbmxj"
Jul 23 18:02:19.367793 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.367774    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661fbde8_4014_4048_aa9d_751c9d24e4a3.slice/crio-bb1bd674de994ea17351697a19ce828ab341ebd8371c495a68d7cd62acb9e397 WatchSource:0}: Error finding container bb1bd674de994ea17351697a19ce828ab341ebd8371c495a68d7cd62acb9e397: Status 404 returned error can't find the container with id bb1bd674de994ea17351697a19ce828ab341ebd8371c495a68d7cd62acb9e397
Jul 23 18:02:19.373764 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.373747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6m8fr"
Jul 23 18:02:19.381206 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.381187    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696a2281_26ef_43ff_a78e_d02bab924388.slice/crio-41564afae27b64042213f0c67ab45127cb2f0804effe5b888a25fc16f9e2b91b WatchSource:0}: Error finding container 41564afae27b64042213f0c67ab45127cb2f0804effe5b888a25fc16f9e2b91b: Status 404 returned error can't find the container with id 41564afae27b64042213f0c67ab45127cb2f0804effe5b888a25fc16f9e2b91b
Jul 23 18:02:19.396351 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.396330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kzc8d"
Jul 23 18:02:19.403034 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:19.403014    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5842ed4d_93da_42af_a368_eae65c64dc89.slice/crio-bd3491ccda28c36b35483090f71e146bf833c35e53894b7654165d8f944c5b2e WatchSource:0}: Error finding container bd3491ccda28c36b35483090f71e146bf833c35e53894b7654165d8f944c5b2e: Status 404 returned error can't find the container with id bd3491ccda28c36b35483090f71e146bf833c35e53894b7654165d8f944c5b2e
Jul 23 18:02:19.521165 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.521135    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:19.607108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.607051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:19.607194 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.607126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:19.607194 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.607184    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:19.607305 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.607250    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:20.60722882 +0000 UTC m=+3.019931603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:19.607377 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.607300    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:19.607377 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.607367    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:02:20.607348132 +0000 UTC m=+3.020050902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:19.708332 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.708301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:19.708472 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.708452    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:19.708564 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.708481    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:19.708564 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.708505    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:19.708679 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:19.708566    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:20.708546492 +0000 UTC m=+3.121249285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:19.864882 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:19.864808    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:20.036809 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.036726    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:57:19 +0000 UTC" deadline="2028-01-15 13:33:12.046520445 +0000 UTC"
Jul 23 18:02:20.036809 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.036791    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12979h30m52.009733307s"
Jul 23 18:02:20.119231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.118576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:20.119231 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.118720    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:20.124458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.124327    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9" event={"ID":"6907a410-2655-45db-9b61-d8d72c0cf8f6","Type":"ContainerStarted","Data":"04de97b5e6a9f45275e03089a3055dff6257d1ea0a95a91c70e2dc9a3108f2c8"}
Jul 23 18:02:20.126339 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.126310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"dec657f5394b396856547c6624e52dd50b91e23eaadc99725c733aae649dc97b"}
Jul 23 18:02:20.128614 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.128590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxkzb" event={"ID":"ba8260da-1727-4036-9863-bf1197441f18","Type":"ContainerStarted","Data":"dd36aa7b20806b19a6869d751282da10fbeab39555f0b948c37d85888fbf8bb2"}
Jul 23 18:02:20.130189 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.130164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzc8d" event={"ID":"5842ed4d-93da-42af-a368-eae65c64dc89","Type":"ContainerStarted","Data":"bd3491ccda28c36b35483090f71e146bf833c35e53894b7654165d8f944c5b2e"}
Jul 23 18:02:20.132681 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.132657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerStarted","Data":"bb1bd674de994ea17351697a19ce828ab341ebd8371c495a68d7cd62acb9e397"}
Jul 23 18:02:20.134217 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.134185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"15ea91eb67e7eb0dff38d12d61c652ba","Type":"ContainerStarted","Data":"0a442e42022bcc3fec88793b9b891a68bfd5e366598048c307d95fb2dc9e85bc"}
Jul 23 18:02:20.136204 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.136130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal" event={"ID":"f70772c471111bb88b9c0b05ceea9c74","Type":"ContainerStarted","Data":"8656cab1725e06c61bbbb0215d70c6e69c15b2b4825cb9daab86788df987dbb5"}
Jul 23 18:02:20.137716 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.137693    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6m8fr" event={"ID":"696a2281-26ef-43ff-a78e-d02bab924388","Type":"ContainerStarted","Data":"41564afae27b64042213f0c67ab45127cb2f0804effe5b888a25fc16f9e2b91b"}
Jul 23 18:02:20.140065 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.140016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94mlk" event={"ID":"e1b23a98-57c4-4096-ad70-8237c8c8b2a1","Type":"ContainerStarted","Data":"f949daefa52f4cf64d62145fc478983d6a426b0a61e6670f89cab2743678d880"}
Jul 23 18:02:20.141526 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.141477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pv6k8" event={"ID":"0e181d1e-e225-4818-b31f-54a17e681e93","Type":"ContainerStarted","Data":"c6accd4415826aacab58f169038c57d985c01322dc26797c908cfb7ef4d8e7fb"}
Jul 23 18:02:20.616161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.616124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:20.616357 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.616216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:20.616357 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.616298    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:20.616357 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.616337    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:20.616564 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.616376    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.616355389 +0000 UTC m=+5.029058171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:20.616564 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.616396    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.616385928 +0000 UTC m=+5.029088702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:20.717502 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.716860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:20.717502 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.717043    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:20.717502 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.717062    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:20.717502 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.717075    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:20.717502 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:20.717133    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.717113283 +0000 UTC m=+5.129816099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:20.813532 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:20.813500    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:21.037688 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:21.037647    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:57:19 +0000 UTC" deadline="2027-12-19 20:42:54.497478903 +0000 UTC"
Jul 23 18:02:21.037688 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:21.037688    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12338h40m33.459795478s"
Jul 23 18:02:21.115975 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:21.115908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:21.116156 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:21.116063    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:21.116231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:21.116199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:21.116347 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:21.116323    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:22.118164 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:22.117985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:22.118164 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.118147    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:22.631812 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:22.631775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:22.632000 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:22.631851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:22.632067 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.632024    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:22.632123 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.632094    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:26.632063252 +0000 UTC m=+9.044766020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:22.632548 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.632522    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:22.632647 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.632589    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:02:26.63257263 +0000 UTC m=+9.045275401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:22.732638 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:22.732601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:22.732919 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.732897    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:22.732919 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.732926    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:22.733070 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.732939    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:22.733070 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:22.733007    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:26.732987244 +0000 UTC m=+9.145690014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:23.116052 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:23.116025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:23.116233 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:23.116163    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:23.116576 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:23.116549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:23.116692 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:23.116669    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:24.120779 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:24.120250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:24.120779 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:24.120385    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:25.116629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:25.116153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:25.116629 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:25.116283    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:25.116890 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:25.116636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:25.116890 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:25.116729    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:26.119071 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:26.119039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:26.119553 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.119176    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:26.665393 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:26.665261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:26.665393 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:26.665310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:26.665643 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.665437    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:26.665643 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.665502    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:02:34.665481974 +0000 UTC m=+17.078184751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:26.665750 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.665704    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:26.665803 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.665752    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:34.665737192 +0000 UTC m=+17.078439971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:26.765967 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:26.765943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:26.766096 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.766083    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:26.766161 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.766102    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:26.766161 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.766114    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:26.766264 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:26.766165    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:34.766147981 +0000 UTC m=+17.178850772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:27.115560 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:27.115516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:27.115730 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:27.115653    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:27.116001 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:27.115980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:27.116091 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:27.116078    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:28.115577 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:28.115544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:28.116024 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:28.115690    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:29.116477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:29.116446    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:29.116934 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:29.116493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:29.116934 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:29.116574    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:29.117050 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:29.116967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:30.116254 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:30.116221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:30.116447 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:30.116364    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:31.116265 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:31.116224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:31.116265 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:31.116273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:31.116811 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:31.116379    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:31.116811 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:31.116511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:32.115830 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:32.115791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:32.116014 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:32.115959    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:33.115823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:33.115754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:33.116209 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:33.115755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:33.116209 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:33.115863    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:33.116209 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:33.115922    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:34.116595 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:34.116561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:34.116986 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.116702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:34.728847 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:34.728817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:34.729041 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:34.728874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:34.729041 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.728971    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:34.729041 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.729033    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:02:50.729017339 +0000 UTC m=+33.141720106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:34.729170 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.728971    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:34.729170 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.729117    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:50.729103189 +0000 UTC m=+33.141805960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:34.829672 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:34.829635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:34.829889 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.829787    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:34.829889 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.829811    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:34.829889 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.829822    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:34.829889 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:34.829880    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:50.829861713 +0000 UTC m=+33.242564497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:35.115945 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:35.115917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:35.116131 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:35.116019    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:35.116131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:35.116092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:35.116240 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:35.116186    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:36.116689 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:36.116652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:36.117087 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:36.116769    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:37.116399 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:37.116362    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:37.116575 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:37.116403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:37.116575 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:37.116498    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:37.116668 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:37.116626    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:38.116703 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:38.116568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:38.117129 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:38.116701    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:38.368426 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:38.368363    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9db23c5_2cba_4d14_af46_7e2b369e166b.slice/crio-13ce2e345ce550eb5ad3de8b243bc51e0052df5c95e6c2b7022f5729ca9542a8 WatchSource:0}: Error finding container 13ce2e345ce550eb5ad3de8b243bc51e0052df5c95e6c2b7022f5729ca9542a8: Status 404 returned error can't find the container with id 13ce2e345ce550eb5ad3de8b243bc51e0052df5c95e6c2b7022f5729ca9542a8
Jul 23 18:02:39.116164 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.115877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:39.116278 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.115880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:39.116278 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:39.116242    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:39.116376 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:39.116330    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:39.179875 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.179812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-94mlk" event={"ID":"e1b23a98-57c4-4096-ad70-8237c8c8b2a1","Type":"ContainerStarted","Data":"11b89778b3db65f05a79d8d60998466215c347745edba84316a2f39d22bcc643"}
Jul 23 18:02:39.181263 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.181242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pv6k8" event={"ID":"0e181d1e-e225-4818-b31f-54a17e681e93","Type":"ContainerStarted","Data":"bcda2b52881014e40bb44a9550f74a41c503ceecf8070247d83824d4d829b3d8"}
Jul 23 18:02:39.182610 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.182589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9" event={"ID":"6907a410-2655-45db-9b61-d8d72c0cf8f6","Type":"ContainerStarted","Data":"0ea73960076b511a69c1603efe6870e26366747d5b6fefa069929f11dc81e5a2"}
Jul 23 18:02:39.185334 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.185316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"09fd25662349cc33f2981638d3a9b07334f7510cd4837632f643578d04e73481"}
Jul 23 18:02:39.185426 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.185376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"d18325b68016101b4f43adbfc784863eda7c6c7d348bf62bc2985a8094ce8934"}
Jul 23 18:02:39.185426 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.185422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"0e116d3e9862812599fb98e7b410171ecd69131232380c5bbfa84da9b352d5c6"}
Jul 23 18:02:39.185516 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.185454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"74ddb38203e70c2f496feae783031a43b27c0aa878b38b627b93978dde1d43ee"}
Jul 23 18:02:39.185516 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.185481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"506a54dfcaf2cc44a64a6f886251fe7784ffd0529e0c3cf626fc7037893d208b"}
Jul 23 18:02:39.185594 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.185517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"b5b46a0e19a25ebba617240b7f6d096f86f20caeace4e473870e37014b36b94e"}
Jul 23 18:02:39.186302 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.186287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wbqg5" event={"ID":"c9db23c5-2cba-4d14-af46-7e2b369e166b","Type":"ContainerStarted","Data":"13ce2e345ce550eb5ad3de8b243bc51e0052df5c95e6c2b7022f5729ca9542a8"}
Jul 23 18:02:39.187497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.187474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxkzb" event={"ID":"ba8260da-1727-4036-9863-bf1197441f18","Type":"ContainerStarted","Data":"4250a74a598afcf76e6d3933f37b8da82c3627f86a5575c3ac10a58df44bbfa0"}
Jul 23 18:02:39.188732 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.188715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kzc8d" event={"ID":"5842ed4d-93da-42af-a368-eae65c64dc89","Type":"ContainerStarted","Data":"4e04268a7dff6fc42ed8891325cde7855c914de376aaf0499ff8547286301841"}
Jul 23 18:02:39.190037 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.190019    2578 generic.go:356] "Generic (PLEG): container finished" podID="661fbde8-4014-4048-aa9d-751c9d24e4a3" containerID="478bc3033f22e75ba0eced9a4d1926d87519e7e220311fbf599f3591b9016391" exitCode=0
Jul 23 18:02:39.190096 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.190084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerDied","Data":"478bc3033f22e75ba0eced9a4d1926d87519e7e220311fbf599f3591b9016391"}
Jul 23 18:02:39.191579 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.191557    2578 generic.go:356] "Generic (PLEG): container finished" podID="15ea91eb67e7eb0dff38d12d61c652ba" containerID="c846c54ca68a3fd3c1823bac2f827be5de46b8f089eb3d9fe9ad24b2561d842d" exitCode=0
Jul 23 18:02:39.191640 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.191619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"15ea91eb67e7eb0dff38d12d61c652ba","Type":"ContainerDied","Data":"c846c54ca68a3fd3c1823bac2f827be5de46b8f089eb3d9fe9ad24b2561d842d"}
Jul 23 18:02:39.193067 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.193046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal" event={"ID":"f70772c471111bb88b9c0b05ceea9c74","Type":"ContainerStarted","Data":"ee101c95cd28cbe12dcc9abbc6d7f6e43fe808f55a02ce5a4449900af7e1219f"}
Jul 23 18:02:39.193180 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.193166    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:39.194426 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.194329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6m8fr" event={"ID":"696a2281-26ef-43ff-a78e-d02bab924388","Type":"ContainerStarted","Data":"63f075fe3baea390b653d93abd00ae9f42599956c134b97e64112f8167da4034"}
Jul 23 18:02:39.203399 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.203376    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:02:39.205054 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.205007    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-94mlk" podStartSLOduration=2.190464316 podStartE2EDuration="21.204996965s" totalImagesPullingTime="19.014532649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:39.203555252 +0000 UTC m=+21.616258041" watchObservedRunningTime="2026-07-23 18:02:39.204996965 +0000 UTC m=+21.617699752"
Jul 23 18:02:39.205881 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.205859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"]
Jul 23 18:02:39.219209 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.219161    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vxkzb" podStartSLOduration=1.379129467 podStartE2EDuration="20.219146533s" totalImagesPullingTime="18.840017066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:39.218558286 +0000 UTC m=+21.631261088" watchObservedRunningTime="2026-07-23 18:02:39.219146533 +0000 UTC m=+21.631849321"
Jul 23 18:02:39.252462 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.252425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pv6k8" podStartSLOduration=2.226836231 podStartE2EDuration="21.252400614s" totalImagesPullingTime="19.025564383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:39.252176623 +0000 UTC m=+21.664879412" watchObservedRunningTime="2026-07-23 18:02:39.252400614 +0000 UTC m=+21.665103402"
Jul 23 18:02:39.293709 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.293533    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kzc8d" podStartSLOduration=2.3322891439999998 podStartE2EDuration="21.293517819s" totalImagesPullingTime="18.961228675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:39.293103589 +0000 UTC m=+21.705806379" watchObservedRunningTime="2026-07-23 18:02:39.293517819 +0000 UTC m=+21.706220607"
Jul 23 18:02:39.311171 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.311135    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6m8fr" podStartSLOduration=7.881826906 podStartE2EDuration="21.311122652s" totalImagesPullingTime="13.429295746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:39.311015327 +0000 UTC m=+21.723718116" watchObservedRunningTime="2026-07-23 18:02:39.311122652 +0000 UTC m=+21.723825440"
Jul 23 18:02:39.831971 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.831936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:39.832588 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.832567    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:39.865358 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:39.865320    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal" podStartSLOduration=0.865307433 podStartE2EDuration="865.307433ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:39.847345536 +0000 UTC m=+22.260048325" watchObservedRunningTime="2026-07-23 18:02:39.865307433 +0000 UTC m=+22.278010221"
Jul 23 18:02:40.116112 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.116033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:40.116261 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:40.116179    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:40.197471 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.197438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wbqg5" event={"ID":"c9db23c5-2cba-4d14-af46-7e2b369e166b","Type":"ContainerStarted","Data":"25f9a39d7ab08e03b31b29030f5ea57a637d95170d5cb39bdb270debebe37c70"}
Jul 23 18:02:40.199063 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.199025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"15ea91eb67e7eb0dff38d12d61c652ba","Type":"ContainerStarted","Data":"faa6cdf53579aa5d7f9c85e038e13f5d1cb282f7834f82a8770c3deb44bc74e1"}
Jul 23 18:02:40.199301 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.199285    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:40.199869 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.199853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:40.200229 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.200215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vxkzb"
Jul 23 18:02:40.207149 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.207129    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:02:40.207237 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:40.207171    2578 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 23 18:02:40.217031 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.216992    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wbqg5" podStartSLOduration=21.216982108 podStartE2EDuration="21.216982108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:40.216437009 +0000 UTC m=+22.629139793" watchObservedRunningTime="2026-07-23 18:02:40.216982108 +0000 UTC m=+22.629684895"
Jul 23 18:02:40.234057 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.234015    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" podStartSLOduration=21.23400107 podStartE2EDuration="21.23400107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:40.233444073 +0000 UTC m=+22.646146875" watchObservedRunningTime="2026-07-23 18:02:40.23400107 +0000 UTC m=+22.646703857"
Jul 23 18:02:40.966090 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:40.966070    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 18:02:41.078251 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.078157    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:02:40.966087043Z","UUID":"48e0ae73-e8b1-4c55-a568-da082936f556","Handler":null,"Name":"","Endpoint":""}
Jul 23 18:02:41.079834 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.079813    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 18:02:41.079936 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.079850    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 18:02:41.116570 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.116505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:41.116570 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.116550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:41.116752 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:41.116626    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:41.116799 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:41.116763    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:41.202707 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.202677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9" event={"ID":"6907a410-2655-45db-9b61-d8d72c0cf8f6","Type":"ContainerStarted","Data":"a5db9529794a933dfb68a256d194f7216473d712796f0b581df4a3b309f2f69a"}
Jul 23 18:02:41.205902 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:41.205878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"55668e02cbdef0fc4184a10dcf96e911c5e3dcd2a479d2f9433c80fc3d7ea1da"}
Jul 23 18:02:42.119442 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:42.119399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:42.119671 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:42.119532    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:43.116263 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:43.116234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:43.116263 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:43.116266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:43.116781 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:43.116353    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:43.116781 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:43.116511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:44.119947 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.119792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:44.120399 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:44.120022    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:44.213561 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.213487    2578 generic.go:356] "Generic (PLEG): container finished" podID="661fbde8-4014-4048-aa9d-751c9d24e4a3" containerID="b3af01612c8a52331b8ac7a4b46ae235e05b3338b972adec9e8c0938a7907403" exitCode=0
Jul 23 18:02:44.213694 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.213575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerDied","Data":"b3af01612c8a52331b8ac7a4b46ae235e05b3338b972adec9e8c0938a7907403"}
Jul 23 18:02:44.217815 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.217789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" event={"ID":"3e78ea65-2ea1-4995-b820-30839c2ad8fe","Type":"ContainerStarted","Data":"6f85c2035c64865eb04eeb501ef8f7cff94d9b78e1cfd2d9858f571331d10331"}
Jul 23 18:02:44.218096 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.218057    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:44.218206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.218127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:44.234573 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.234551    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:44.264788 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:44.264743    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk" podStartSLOduration=6.94979523 podStartE2EDuration="26.264729002s" totalImagesPullingTime="19.314933772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:44.262993027 +0000 UTC m=+26.675695814" watchObservedRunningTime="2026-07-23 18:02:44.264729002 +0000 UTC m=+26.677431791"
Jul 23 18:02:45.116238 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.116210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:45.116238 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.116230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:45.116500 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:45.116309    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:45.116500 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:45.116477    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:45.221467 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.221433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9" event={"ID":"6907a410-2655-45db-9b61-d8d72c0cf8f6","Type":"ContainerStarted","Data":"52eabb98b1e888cc6493e73fee8847db5f8d8318b0b5a8a7739950a341a375de"}
Jul 23 18:02:45.221958 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.221786    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:45.236233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.236214    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:02:45.241661 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.241622    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nlfc9" podStartSLOduration=7.659645906 podStartE2EDuration="27.2416106s" totalImagesPullingTime="19.581964694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:45.241184126 +0000 UTC m=+27.653886915" watchObservedRunningTime="2026-07-23 18:02:45.2416106 +0000 UTC m=+27.654313388"
Jul 23 18:02:45.618421 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.618388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxhw6"]
Jul 23 18:02:45.618585 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.618517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:45.618650 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:45.618629    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:45.619009 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.618974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qms52"]
Jul 23 18:02:45.619129 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.619076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:45.619195 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:45.619159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:45.619546 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.619523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9stdm"]
Jul 23 18:02:45.619636 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:45.619607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:45.619694 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:45.619678    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:46.225252 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:46.225023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerStarted","Data":"d12690b3ee5b19cb5a35c5bdb68bcd153395ff54c80c605c3e3494ba5a5c81c0"}
Jul 23 18:02:47.116494 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:47.116472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:47.116629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:47.116507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:47.116629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:47.116555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:47.116629 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:47.116566    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:47.116729 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:47.116628    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:47.116729 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:47.116700    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:47.229537 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:47.229509    2578 generic.go:356] "Generic (PLEG): container finished" podID="661fbde8-4014-4048-aa9d-751c9d24e4a3" containerID="d12690b3ee5b19cb5a35c5bdb68bcd153395ff54c80c605c3e3494ba5a5c81c0" exitCode=0
Jul 23 18:02:47.229867 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:47.229597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerDied","Data":"d12690b3ee5b19cb5a35c5bdb68bcd153395ff54c80c605c3e3494ba5a5c81c0"}
Jul 23 18:02:48.234028 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:48.233961    2578 generic.go:356] "Generic (PLEG): container finished" podID="661fbde8-4014-4048-aa9d-751c9d24e4a3" containerID="9ace36a8d3247d5bad915cc4fe6da0d8bde99fa07e4018a738732c815334b93c" exitCode=0
Jul 23 18:02:48.234028 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:48.234012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerDied","Data":"9ace36a8d3247d5bad915cc4fe6da0d8bde99fa07e4018a738732c815334b93c"}
Jul 23 18:02:49.115751 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:49.115722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:49.115932 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:49.115846    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:49.115932 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:49.115841    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:49.115932 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:49.115891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:49.116076 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:49.115982    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:49.116076 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:49.116035    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:50.756758 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:50.756680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:50.756758 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:50.756727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:50.757189 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.756835    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:50.757189 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.756910    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs podName:0636b89a-e0b6-48ef-88b8-2df4c707dbbd nodeName:}" failed. No retries permitted until 2026-07-23 18:03:22.756890469 +0000 UTC m=+65.169593241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs") pod "network-metrics-daemon-9stdm" (UID: "0636b89a-e0b6-48ef-88b8-2df4c707dbbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:50.757189 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.756839    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:50.757189 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.756962    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret podName:3b4e3eef-9fac-4b55-ad64-b51b68d72ba7 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:22.7569512 +0000 UTC m=+65.169653967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret") pod "global-pull-secret-syncer-mxhw6" (UID: "3b4e3eef-9fac-4b55-ad64-b51b68d72ba7") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:50.857734 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:50.857549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:50.857871 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.857703    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:50.857871 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.857802    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:50.857871 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.857814    2578 projected.go:196] Error preparing data for projected volume kube-api-access-rsbdd for pod openshift-network-diagnostics/network-check-target-qms52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:50.857871 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:50.857860    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd podName:e3b774d9-ac6b-4652-91cc-1757db758b5f nodeName:}" failed. No retries permitted until 2026-07-23 18:03:22.857845082 +0000 UTC m=+65.270547869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsbdd" (UniqueName: "kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd") pod "network-check-target-qms52" (UID: "e3b774d9-ac6b-4652-91cc-1757db758b5f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:51.116388 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.116359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:51.116388 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.116385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:51.116630 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.116504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:51.116630 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.116508    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxhw6" podUID="3b4e3eef-9fac-4b55-ad64-b51b68d72ba7"
Jul 23 18:02:51.116630 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.116583    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qms52" podUID="e3b774d9-ac6b-4652-91cc-1757db758b5f"
Jul 23 18:02:51.116745 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.116676    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9stdm" podUID="0636b89a-e0b6-48ef-88b8-2df4c707dbbd"
Jul 23 18:02:51.412437 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.412398    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeReady"
Jul 23 18:02:51.412623 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.412560    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 18:02:51.451936 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.451907    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cb44f59f5-r5m9h"]
Jul 23 18:02:51.477847 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.477825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb44f59f5-r5m9h"]
Jul 23 18:02:51.477953 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.477861    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tfhcq"]
Jul 23 18:02:51.477953 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.477939    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.480423 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.480387    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 18:02:51.480528 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.480443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 18:02:51.480592 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.480571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 18:02:51.480738 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.480711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7nzjz\""
Jul 23 18:02:51.488466 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.488274    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 18:02:51.491871 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.491854    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w2psm"]
Jul 23 18:02:51.491990 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.491971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.494620 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.494595    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 18:02:51.494831 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.494814    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vl72\""
Jul 23 18:02:51.494938 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.494870    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 18:02:51.510202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.510184    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w2psm"]
Jul 23 18:02:51.510290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.510217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tfhcq"]
Jul 23 18:02:51.510339 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.510318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.512860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.512840    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 18:02:51.512972 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.512948    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 18:02:51.513033 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.512992    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 18:02:51.513033 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.513002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w9bh8\""
Jul 23 18:02:51.562688 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.562800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnbr5\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-kube-api-access-rnbr5\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.562800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-image-registry-private-configuration\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.562800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-installation-pull-secrets\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.562956 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-bound-sa-token\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.562956 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-trusted-ca\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.563050 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.562963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7bb764f9-da0d-4905-80e6-276f7ac7ab39-ca-trust-extracted\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.563050 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.563016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-certificates\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.663457 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-installation-pull-secrets\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.663457 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.663725 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-bound-sa-token\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.663725 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a507bcd-b2a9-4332-9eb2-5c4c109139a4-cert\") pod \"ingress-canary-w2psm\" (UID: \"7a507bcd-b2a9-4332-9eb2-5c4c109139a4\") " pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.663725 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-trusted-ca\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.663725 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b32355be-6a39-4b3f-95e0-8b320036a69c-tmp-dir\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.663912 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7bb764f9-da0d-4905-80e6-276f7ac7ab39-ca-trust-extracted\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.663912 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b32355be-6a39-4b3f-95e0-8b320036a69c-config-volume\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.663912 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-certificates\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.664047 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.664047 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnbr5\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-kube-api-access-rnbr5\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.664047 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.663999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6jhq\" (UniqueName: \"kubernetes.io/projected/7a507bcd-b2a9-4332-9eb2-5c4c109139a4-kube-api-access-w6jhq\") pod \"ingress-canary-w2psm\" (UID: \"7a507bcd-b2a9-4332-9eb2-5c4c109139a4\") " pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.664047 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.664031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-image-registry-private-configuration\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.664225 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.664058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r8gh\" (UniqueName: \"kubernetes.io/projected/b32355be-6a39-4b3f-95e0-8b320036a69c-kube-api-access-7r8gh\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.664225 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.664067    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:51.664225 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.664087    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb44f59f5-r5m9h: secret "image-registry-tls" not found
Jul 23 18:02:51.664225 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.664126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7bb764f9-da0d-4905-80e6-276f7ac7ab39-ca-trust-extracted\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.664225 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.664144    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls podName:7bb764f9-da0d-4905-80e6-276f7ac7ab39 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:52.16412458 +0000 UTC m=+34.576827360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls") pod "image-registry-cb44f59f5-r5m9h" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39") : secret "image-registry-tls" not found
Jul 23 18:02:51.664550 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.664527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-certificates\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.664724 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.664706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-trusted-ca\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.668062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.668040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-installation-pull-secrets\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.668062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.668055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-image-registry-private-configuration\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.675290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.675270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnbr5\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-kube-api-access-rnbr5\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.675553 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.675531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-bound-sa-token\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:51.764718 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.764680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6jhq\" (UniqueName: \"kubernetes.io/projected/7a507bcd-b2a9-4332-9eb2-5c4c109139a4-kube-api-access-w6jhq\") pod \"ingress-canary-w2psm\" (UID: \"7a507bcd-b2a9-4332-9eb2-5c4c109139a4\") " pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.764718 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.764718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r8gh\" (UniqueName: \"kubernetes.io/projected/b32355be-6a39-4b3f-95e0-8b320036a69c-kube-api-access-7r8gh\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.764769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.764798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a507bcd-b2a9-4332-9eb2-5c4c109139a4-cert\") pod \"ingress-canary-w2psm\" (UID: \"7a507bcd-b2a9-4332-9eb2-5c4c109139a4\") " pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.764823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b32355be-6a39-4b3f-95e0-8b320036a69c-tmp-dir\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.764868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b32355be-6a39-4b3f-95e0-8b320036a69c-config-volume\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.764928    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:51.764997    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls podName:b32355be-6a39-4b3f-95e0-8b320036a69c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:52.264974051 +0000 UTC m=+34.677676816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls") pod "dns-default-tfhcq" (UID: "b32355be-6a39-4b3f-95e0-8b320036a69c") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:51.765281 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.765223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b32355be-6a39-4b3f-95e0-8b320036a69c-tmp-dir\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.765653 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.765382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b32355be-6a39-4b3f-95e0-8b320036a69c-config-volume\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.767351 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.767326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a507bcd-b2a9-4332-9eb2-5c4c109139a4-cert\") pod \"ingress-canary-w2psm\" (UID: \"7a507bcd-b2a9-4332-9eb2-5c4c109139a4\") " pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.775994 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.775968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r8gh\" (UniqueName: \"kubernetes.io/projected/b32355be-6a39-4b3f-95e0-8b320036a69c-kube-api-access-7r8gh\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:51.776734 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.776705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6jhq\" (UniqueName: \"kubernetes.io/projected/7a507bcd-b2a9-4332-9eb2-5c4c109139a4-kube-api-access-w6jhq\") pod \"ingress-canary-w2psm\" (UID: \"7a507bcd-b2a9-4332-9eb2-5c4c109139a4\") " pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:51.822838 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:51.822815    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w2psm"
Jul 23 18:02:52.167556 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:52.167519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:52.167747 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:52.167700    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:52.167747 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:52.167721    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb44f59f5-r5m9h: secret "image-registry-tls" not found
Jul 23 18:02:52.167861 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:52.167785    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls podName:7bb764f9-da0d-4905-80e6-276f7ac7ab39 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:53.167764005 +0000 UTC m=+35.580466791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls") pod "image-registry-cb44f59f5-r5m9h" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39") : secret "image-registry-tls" not found
Jul 23 18:02:52.268139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:52.268110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:52.268322 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:52.268229    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:52.268322 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:52.268290    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls podName:b32355be-6a39-4b3f-95e0-8b320036a69c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:53.268269865 +0000 UTC m=+35.680972632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls") pod "dns-default-tfhcq" (UID: "b32355be-6a39-4b3f-95e0-8b320036a69c") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:52.558102 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:52.558075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w2psm"]
Jul 23 18:02:52.687854 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:52.687824    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a507bcd_b2a9_4332_9eb2_5c4c109139a4.slice/crio-7674dc6b3d6d848b72538046ae4aa0ffd194f3fb9bae5d2f840269e516218b43 WatchSource:0}: Error finding container 7674dc6b3d6d848b72538046ae4aa0ffd194f3fb9bae5d2f840269e516218b43: Status 404 returned error can't find the container with id 7674dc6b3d6d848b72538046ae4aa0ffd194f3fb9bae5d2f840269e516218b43
Jul 23 18:02:53.116192 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.116015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:02:53.116931 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.116031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:02:53.116931 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.116031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:02:53.119485 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.119422    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqhz\""
Jul 23 18:02:53.120311 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.120281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 18:02:53.120311 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.120292    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:02:53.120503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.120330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbpx\""
Jul 23 18:02:53.120503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.120362    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 18:02:53.120503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.120454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:02:53.176185 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.176162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:53.176297 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:53.176262    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:53.176297 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:53.176274    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb44f59f5-r5m9h: secret "image-registry-tls" not found
Jul 23 18:02:53.176371 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:53.176330    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls podName:7bb764f9-da0d-4905-80e6-276f7ac7ab39 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:55.176312988 +0000 UTC m=+37.589015757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls") pod "image-registry-cb44f59f5-r5m9h" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39") : secret "image-registry-tls" not found
Jul 23 18:02:53.248645 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.248613    2578 generic.go:356] "Generic (PLEG): container finished" podID="661fbde8-4014-4048-aa9d-751c9d24e4a3" containerID="7f74cabe0fe744e590b7bdf64ab19184a58209f3e3427bc1d0e56f82da534b49" exitCode=0
Jul 23 18:02:53.248786 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.248647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerDied","Data":"7f74cabe0fe744e590b7bdf64ab19184a58209f3e3427bc1d0e56f82da534b49"}
Jul 23 18:02:53.249981 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.249957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w2psm" event={"ID":"7a507bcd-b2a9-4332-9eb2-5c4c109139a4","Type":"ContainerStarted","Data":"7674dc6b3d6d848b72538046ae4aa0ffd194f3fb9bae5d2f840269e516218b43"}
Jul 23 18:02:53.277539 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:53.277515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:53.277672 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:53.277656    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:53.277745 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:53.277709    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls podName:b32355be-6a39-4b3f-95e0-8b320036a69c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:55.277692626 +0000 UTC m=+37.690395396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls") pod "dns-default-tfhcq" (UID: "b32355be-6a39-4b3f-95e0-8b320036a69c") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:54.256343 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:54.256261    2578 generic.go:356] "Generic (PLEG): container finished" podID="661fbde8-4014-4048-aa9d-751c9d24e4a3" containerID="06141722d01ddc0c731a75c1980b0901aec137724f1b37b97fcb5978cbae072a" exitCode=0
Jul 23 18:02:54.256343 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:54.256297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerDied","Data":"06141722d01ddc0c731a75c1980b0901aec137724f1b37b97fcb5978cbae072a"}
Jul 23 18:02:55.191397 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:55.191345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:55.191505 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:55.191472    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:55.191505 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:55.191484    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb44f59f5-r5m9h: secret "image-registry-tls" not found
Jul 23 18:02:55.191572 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:55.191528    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls podName:7bb764f9-da0d-4905-80e6-276f7ac7ab39 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:59.191514059 +0000 UTC m=+41.604216824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls") pod "image-registry-cb44f59f5-r5m9h" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39") : secret "image-registry-tls" not found
Jul 23 18:02:55.262425 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:55.262376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" event={"ID":"661fbde8-4014-4048-aa9d-751c9d24e4a3","Type":"ContainerStarted","Data":"774dd457a3184a38ad87ea4c1223fa9ab0a509d6841fe12fca230750e6197355"}
Jul 23 18:02:55.292096 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:55.292075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:55.292198 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:55.292186    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:55.292242 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:55.292229    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls podName:b32355be-6a39-4b3f-95e0-8b320036a69c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:59.292217614 +0000 UTC m=+41.704920380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls") pod "dns-default-tfhcq" (UID: "b32355be-6a39-4b3f-95e0-8b320036a69c") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:55.296134 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:55.296097    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vbmxj" podStartSLOduration=12.169569174 podStartE2EDuration="37.296083649s" totalImagesPullingTime="25.126514475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:55.295510667 +0000 UTC m=+37.708213475" watchObservedRunningTime="2026-07-23 18:02:55.296083649 +0000 UTC m=+37.708786476"
Jul 23 18:02:56.266255 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.266216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w2psm" event={"ID":"7a507bcd-b2a9-4332-9eb2-5c4c109139a4","Type":"ContainerStarted","Data":"9fb4401c017af283a6371f5ff5326cd624a694ba0907842d7748a434d399e6b8"}
Jul 23 18:02:56.287452 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.287424    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"]
Jul 23 18:02:56.308664 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.308602    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w2psm" podStartSLOduration=2.80484526 podStartE2EDuration="5.30858484s" totalImagesPullingTime="2.50373958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:56.291531217 +0000 UTC m=+38.704234006" watchObservedRunningTime="2026-07-23 18:02:56.30858484 +0000 UTC m=+38.721287630"
Jul 23 18:02:56.357668 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.357649    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"]
Jul 23 18:02:56.357787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.357768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:56.360894 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.360867    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 18:02:56.361004 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.360897    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.361004 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.360916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qgs6t\""
Jul 23 18:02:56.361210 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.361195    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.369552 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.369535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"]
Jul 23 18:02:56.369644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.369572    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"]
Jul 23 18:02:56.369644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.369638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.372837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.372790    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-shpr9\""
Jul 23 18:02:56.372837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.372797    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.372961 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.372841    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 18:02:56.372961 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.372842    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.372961 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.372897    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 18:02:56.385131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.385103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"]
Jul 23 18:02:56.401338 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.401271    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"]
Jul 23 18:02:56.401430 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.401323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.404435 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.404420    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 18:02:56.405605 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.405588    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jr4hr\""
Jul 23 18:02:56.405713 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.405633    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.405781 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.405736    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.405851 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.405831    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 18:02:56.473158 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.473133    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2czr4"]
Jul 23 18:02:56.487420 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.487385    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"]
Jul 23 18:02:56.487504 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.487472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.491875 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.491850    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 18:02:56.491875 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.491865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gkr4v\""
Jul 23 18:02:56.492341 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.492313    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.492623 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.492433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.492957 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.492643    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 18:02:56.497538 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.497520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2czr4"]
Jul 23 18:02:56.497617 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.497550    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"]
Jul 23 18:02:56.497660 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.497637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.499690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55fac291-a9fe-4603-b4b5-c8653547a376-serving-cert\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.499766 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:56.499766 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwjw9\" (UniqueName: \"kubernetes.io/projected/55fac291-a9fe-4603-b4b5-c8653547a376-kube-api-access-fwjw9\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.499829 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/58a9230c-14ed-451a-b8e8-80e0571e4475-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.499829 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.499891 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55fac291-a9fe-4603-b4b5-c8653547a376-config\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.499891 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499850    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcftg\" (UniqueName: \"kubernetes.io/projected/a0045132-f8e8-45ec-b685-aa0d607941ad-kube-api-access-tcftg\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:56.499950 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.499890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzh9g\" (UniqueName: \"kubernetes.io/projected/58a9230c-14ed-451a-b8e8-80e0571e4475-kube-api-access-fzh9g\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.500177 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.500164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 18:02:56.500598 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.500581    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 18:02:56.500894 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.500880    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.501537 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.501515    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.501644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.501625    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 18:02:56.501687 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.501668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gdjwc\""
Jul 23 18:02:56.600162 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55fac291-a9fe-4603-b4b5-c8653547a376-serving-cert\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.600292 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac2c07f-876c-4f8c-869b-29fd7f571275-serving-cert\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.600292 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ac2c07f-876c-4f8c-869b-29fd7f571275-tmp\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.600292 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985qf\" (UniqueName: \"kubernetes.io/projected/a05d7728-4f52-4836-a696-97e67e226a72-kube-api-access-985qf\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.600292 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2c07f-876c-4f8c-869b-29fd7f571275-service-ca-bundle\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.600292 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwjw9\" (UniqueName: \"kubernetes.io/projected/55fac291-a9fe-4603-b4b5-c8653547a376-kube-api-access-fwjw9\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzh9g\" (UniqueName: \"kubernetes.io/projected/58a9230c-14ed-451a-b8e8-80e0571e4475-kube-api-access-fzh9g\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:56.600371    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55fac291-a9fe-4603-b4b5-c8653547a376-config\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:56.600451    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls podName:a0045132-f8e8-45ec-b685-aa0d607941ad nodeName:}" failed. No retries permitted until 2026-07-23 18:02:57.100431542 +0000 UTC m=+39.513134311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nkvwp" (UID: "a0045132-f8e8-45ec-b685-aa0d607941ad") : secret "samples-operator-tls" not found
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2c07f-876c-4f8c-869b-29fd7f571275-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.600518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a05d7728-4f52-4836-a696-97e67e226a72-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ac2c07f-876c-4f8c-869b-29fd7f571275-snapshots\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a05d7728-4f52-4836-a696-97e67e226a72-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/58a9230c-14ed-451a-b8e8-80e0571e4475-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptjpk\" (UniqueName: \"kubernetes.io/projected/0ac2c07f-876c-4f8c-869b-29fd7f571275-kube-api-access-ptjpk\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcftg\" (UniqueName: \"kubernetes.io/projected/a0045132-f8e8-45ec-b685-aa0d607941ad-kube-api-access-tcftg\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:56.600764    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:02:56.600860 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:56.600818    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls podName:58a9230c-14ed-451a-b8e8-80e0571e4475 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:57.100803391 +0000 UTC m=+39.513506169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gwt8v" (UID: "58a9230c-14ed-451a-b8e8-80e0571e4475") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:02:56.601109 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.600910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55fac291-a9fe-4603-b4b5-c8653547a376-config\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.601373 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.601354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/58a9230c-14ed-451a-b8e8-80e0571e4475-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.603897 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.603878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55fac291-a9fe-4603-b4b5-c8653547a376-serving-cert\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.615796 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.615760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcftg\" (UniqueName: \"kubernetes.io/projected/a0045132-f8e8-45ec-b685-aa0d607941ad-kube-api-access-tcftg\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:56.615796 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.615762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzh9g\" (UniqueName: \"kubernetes.io/projected/58a9230c-14ed-451a-b8e8-80e0571e4475-kube-api-access-fzh9g\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:56.615973 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.615839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwjw9\" (UniqueName: \"kubernetes.io/projected/55fac291-a9fe-4603-b4b5-c8653547a376-kube-api-access-fwjw9\") pod \"service-ca-operator-5bcbc94c78-nqvll\" (UID: \"55fac291-a9fe-4603-b4b5-c8653547a376\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.676998 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.676976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"
Jul 23 18:02:56.702117 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2c07f-876c-4f8c-869b-29fd7f571275-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.702212 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a05d7728-4f52-4836-a696-97e67e226a72-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.702212 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ac2c07f-876c-4f8c-869b-29fd7f571275-snapshots\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.702363 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a05d7728-4f52-4836-a696-97e67e226a72-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.702472 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptjpk\" (UniqueName: \"kubernetes.io/projected/0ac2c07f-876c-4f8c-869b-29fd7f571275-kube-api-access-ptjpk\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.702535 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac2c07f-876c-4f8c-869b-29fd7f571275-serving-cert\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.702535 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ac2c07f-876c-4f8c-869b-29fd7f571275-tmp\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.702768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ac2c07f-876c-4f8c-869b-29fd7f571275-tmp\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.702897 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0ac2c07f-876c-4f8c-869b-29fd7f571275-snapshots\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.703003 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.702894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985qf\" (UniqueName: \"kubernetes.io/projected/a05d7728-4f52-4836-a696-97e67e226a72-kube-api-access-985qf\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.703141 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.703109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2c07f-876c-4f8c-869b-29fd7f571275-service-ca-bundle\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.703244 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.703107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a05d7728-4f52-4836-a696-97e67e226a72-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.703461 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.703440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2c07f-876c-4f8c-869b-29fd7f571275-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.703570 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.703544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac2c07f-876c-4f8c-869b-29fd7f571275-service-ca-bundle\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.704768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.704718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a05d7728-4f52-4836-a696-97e67e226a72-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.705054 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.705036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac2c07f-876c-4f8c-869b-29fd7f571275-serving-cert\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.714044 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.714022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptjpk\" (UniqueName: \"kubernetes.io/projected/0ac2c07f-876c-4f8c-869b-29fd7f571275-kube-api-access-ptjpk\") pod \"insights-operator-555d9d7885-2czr4\" (UID: \"0ac2c07f-876c-4f8c-869b-29fd7f571275\") " pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.714574 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.714558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985qf\" (UniqueName: \"kubernetes.io/projected/a05d7728-4f52-4836-a696-97e67e226a72-kube-api-access-985qf\") pod \"kube-storage-version-migrator-operator-7658d9b749-crlmh\" (UID: \"a05d7728-4f52-4836-a696-97e67e226a72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.796770 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.796740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2czr4"
Jul 23 18:02:56.807000 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.806971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"
Jul 23 18:02:56.813649 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.813628    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll"]
Jul 23 18:02:56.816599 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:56.816578    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fac291_a9fe_4603_b4b5_c8653547a376.slice/crio-bf63294a3022f547d43c40bedf3b448a631f7682647dc7c9d496fcf9a686a483 WatchSource:0}: Error finding container bf63294a3022f547d43c40bedf3b448a631f7682647dc7c9d496fcf9a686a483: Status 404 returned error can't find the container with id bf63294a3022f547d43c40bedf3b448a631f7682647dc7c9d496fcf9a686a483
Jul 23 18:02:56.985749 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:56.985721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2czr4"]
Jul 23 18:02:56.988969 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:56.988942    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac2c07f_876c_4f8c_869b_29fd7f571275.slice/crio-ef8bbf8194a45bc95e6bed5838b1f502b32ecdcb60d47bdd0bb0a4ee7482c72c WatchSource:0}: Error finding container ef8bbf8194a45bc95e6bed5838b1f502b32ecdcb60d47bdd0bb0a4ee7482c72c: Status 404 returned error can't find the container with id ef8bbf8194a45bc95e6bed5838b1f502b32ecdcb60d47bdd0bb0a4ee7482c72c
Jul 23 18:02:57.000808 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:57.000787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh"]
Jul 23 18:02:57.003578 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:02:57.003551    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05d7728_4f52_4836_a696_97e67e226a72.slice/crio-e2b5e34d1698ff20787afc2b28222b48eb7583494ebcbe443e8868d238820953 WatchSource:0}: Error finding container e2b5e34d1698ff20787afc2b28222b48eb7583494ebcbe443e8868d238820953: Status 404 returned error can't find the container with id e2b5e34d1698ff20787afc2b28222b48eb7583494ebcbe443e8868d238820953
Jul 23 18:02:57.106825 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:57.106799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:57.106904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:57.106875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:57.106958 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:57.106943    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:02:57.107004 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:57.106993    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls podName:a0045132-f8e8-45ec-b685-aa0d607941ad nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.106979318 +0000 UTC m=+40.519682088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nkvwp" (UID: "a0045132-f8e8-45ec-b685-aa0d607941ad") : secret "samples-operator-tls" not found
Jul 23 18:02:57.107050 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:57.107001    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:02:57.107050 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:57.107045    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls podName:58a9230c-14ed-451a-b8e8-80e0571e4475 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.107032284 +0000 UTC m=+40.519735050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gwt8v" (UID: "58a9230c-14ed-451a-b8e8-80e0571e4475") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:02:57.270277 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:57.270210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2czr4" event={"ID":"0ac2c07f-876c-4f8c-869b-29fd7f571275","Type":"ContainerStarted","Data":"ef8bbf8194a45bc95e6bed5838b1f502b32ecdcb60d47bdd0bb0a4ee7482c72c"}
Jul 23 18:02:57.271603 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:57.271577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh" event={"ID":"a05d7728-4f52-4836-a696-97e67e226a72","Type":"ContainerStarted","Data":"e2b5e34d1698ff20787afc2b28222b48eb7583494ebcbe443e8868d238820953"}
Jul 23 18:02:57.272878 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:57.272848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll" event={"ID":"55fac291-a9fe-4603-b4b5-c8653547a376","Type":"ContainerStarted","Data":"bf63294a3022f547d43c40bedf3b448a631f7682647dc7c9d496fcf9a686a483"}
Jul 23 18:02:58.113312 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:58.113279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:02:58.113521 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:58.113372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:02:58.113521 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:58.113390    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:02:58.113521 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:58.113472    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls podName:58a9230c-14ed-451a-b8e8-80e0571e4475 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.113451406 +0000 UTC m=+42.526154176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gwt8v" (UID: "58a9230c-14ed-451a-b8e8-80e0571e4475") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:02:58.113521 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:58.113508    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:02:58.113758 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:58.113573    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls podName:a0045132-f8e8-45ec-b685-aa0d607941ad nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.113554994 +0000 UTC m=+42.526257760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nkvwp" (UID: "a0045132-f8e8-45ec-b685-aa0d607941ad") : secret "samples-operator-tls" not found
Jul 23 18:02:59.223734 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:59.223690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:02:59.224191 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:59.223824    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:59.224191 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:59.223848    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb44f59f5-r5m9h: secret "image-registry-tls" not found
Jul 23 18:02:59.224191 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:59.223915    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls podName:7bb764f9-da0d-4905-80e6-276f7ac7ab39 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:07.223897056 +0000 UTC m=+49.636599826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls") pod "image-registry-cb44f59f5-r5m9h" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39") : secret "image-registry-tls" not found
Jul 23 18:02:59.324299 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:02:59.324266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:02:59.324488 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:59.324443    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:59.324563 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:02:59.324517    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls podName:b32355be-6a39-4b3f-95e0-8b320036a69c nodeName:}" failed. No retries permitted until 2026-07-23 18:03:07.324497454 +0000 UTC m=+49.737200220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls") pod "dns-default-tfhcq" (UID: "b32355be-6a39-4b3f-95e0-8b320036a69c") : secret "dns-default-metrics-tls" not found
Jul 23 18:03:00.130889 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:00.130858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:03:00.131070 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:00.130924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:03:00.131070 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:00.131023    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:03:00.131179 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:00.131100    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls podName:58a9230c-14ed-451a-b8e8-80e0571e4475 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:04.131080501 +0000 UTC m=+46.543783281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gwt8v" (UID: "58a9230c-14ed-451a-b8e8-80e0571e4475") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:03:00.131179 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:00.131029    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:03:00.131179 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:00.131159    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls podName:a0045132-f8e8-45ec-b685-aa0d607941ad nodeName:}" failed. No retries permitted until 2026-07-23 18:03:04.131147905 +0000 UTC m=+46.543850671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nkvwp" (UID: "a0045132-f8e8-45ec-b685-aa0d607941ad") : secret "samples-operator-tls" not found
Jul 23 18:03:01.283528 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:01.283485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll" event={"ID":"55fac291-a9fe-4603-b4b5-c8653547a376","Type":"ContainerStarted","Data":"a078e9b1429b4bcfba738fdef208b5f8d215a20bc21e406e411c5d06b1e58a71"}
Jul 23 18:03:01.285110 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:01.285086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2czr4" event={"ID":"0ac2c07f-876c-4f8c-869b-29fd7f571275","Type":"ContainerStarted","Data":"a75cbc37cc109a9b4ececa6057dd18a59ef49cec241b44b7f04a6a69e7fcb39d"}
Jul 23 18:03:01.286495 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:01.286474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh" event={"ID":"a05d7728-4f52-4836-a696-97e67e226a72","Type":"ContainerStarted","Data":"82c0fafba75b3ee2d5b7c4e2e1c2033413c733119df53d519771217a18ddb347"}
Jul 23 18:03:01.321188 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:01.321134    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll" podStartSLOduration=1.517102515 podStartE2EDuration="5.321114967s" totalImagesPullingTime="3.804012452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.320766996 +0000 UTC m=+43.733469775" watchObservedRunningTime="2026-07-23 18:03:01.321114967 +0000 UTC m=+43.733817756"
Jul 23 18:03:01.346593 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:01.346538    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-2czr4" podStartSLOduration=1.717113179 podStartE2EDuration="5.346518308s" totalImagesPullingTime="3.629405129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.346241359 +0000 UTC m=+43.758944148" watchObservedRunningTime="2026-07-23 18:03:01.346518308 +0000 UTC m=+43.759221097"
Jul 23 18:03:01.387257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:01.387200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh" podStartSLOduration=1.76432778 podStartE2EDuration="5.387183094s" totalImagesPullingTime="3.622855314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.38662239 +0000 UTC m=+43.799325178" watchObservedRunningTime="2026-07-23 18:03:01.387183094 +0000 UTC m=+43.799886114"
Jul 23 18:03:02.216581 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.216553    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-frb6w"]
Jul 23 18:03:02.248477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.248450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frb6w"]
Jul 23 18:03:02.248637 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.248567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.251590 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.251566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 18:03:02.251590 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.251571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtwn7\""
Jul 23 18:03:02.251775 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.251572    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 18:03:02.349620 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.349587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.349978 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.349638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69a7cbc-a579-410e-b848-68d5ff435526-data-volume\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.349978 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.349687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c69a7cbc-a579-410e-b848-68d5ff435526-crio-socket\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.349978 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.349724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.349978 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.349752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl7jw\" (UniqueName: \"kubernetes.io/projected/c69a7cbc-a579-410e-b848-68d5ff435526-kube-api-access-fl7jw\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450352 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69a7cbc-a579-410e-b848-68d5ff435526-data-volume\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450541 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c69a7cbc-a579-410e-b848-68d5ff435526-crio-socket\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450620 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450681 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl7jw\" (UniqueName: \"kubernetes.io/projected/c69a7cbc-a579-410e-b848-68d5ff435526-kube-api-access-fl7jw\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69a7cbc-a579-410e-b848-68d5ff435526-data-volume\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450844 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.450811    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:02.450897 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.450836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c69a7cbc-a579-410e-b848-68d5ff435526-crio-socket\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.450897 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.450849    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.450897 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.450878    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.950859336 +0000 UTC m=+45.363562102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:02.451051 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.450915    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.950898386 +0000 UTC m=+45.363601161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.470260 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.470205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl7jw\" (UniqueName: \"kubernetes.io/projected/c69a7cbc-a579-410e-b848-68d5ff435526-kube-api-access-fl7jw\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.955896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.955856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.956047 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:02.955933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:02.956047 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.955942    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.956047 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.956008    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:03.955987271 +0000 UTC m=+46.368690057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.956216 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.956054    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:02.956216 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:02.956106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:03.956094162 +0000 UTC m=+46.368796930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:03.961849 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:03.961815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:03.962220 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:03.961877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:03.962220 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:03.961945    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:03.962220 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:03.962016    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:05.961996791 +0000 UTC m=+48.374699562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:03.962220 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:03.962025    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:03.962220 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:03.962071    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:05.962058587 +0000 UTC m=+48.374761352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:03.982564 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:03.982546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6m8fr_696a2281-26ef-43ff-a78e-d02bab924388/dns-node-resolver/0.log"
Jul 23 18:03:04.164095 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:04.164069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:03:04.164256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:04.164156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:03:04.164256 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:04.164208    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:03:04.164362 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:04.164262    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls podName:58a9230c-14ed-451a-b8e8-80e0571e4475 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:12.16424882 +0000 UTC m=+54.576951586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gwt8v" (UID: "58a9230c-14ed-451a-b8e8-80e0571e4475") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:03:04.164362 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:04.164290    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:03:04.164362 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:04.164346    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls podName:a0045132-f8e8-45ec-b685-aa0d607941ad nodeName:}" failed. No retries permitted until 2026-07-23 18:03:12.164330952 +0000 UTC m=+54.577033734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nkvwp" (UID: "a0045132-f8e8-45ec-b685-aa0d607941ad") : secret "samples-operator-tls" not found
Jul 23 18:03:05.183830 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:05.183802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzc8d_5842ed4d-93da-42af-a368-eae65c64dc89/node-ca/0.log"
Jul 23 18:03:05.976354 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:05.976320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:05.976619 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:05.976373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:05.976619 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:05.976456    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:05.976619 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:05.976474    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:05.976619 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:05.976517    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:09.976503549 +0000 UTC m=+52.389206315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:05.976619 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:05.976531    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:09.976524657 +0000 UTC m=+52.389227422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:06.184469 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:06.184446    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w2psm_7a507bcd-b2a9-4332-9eb2-5c4c109139a4/serve-healthcheck-canary/0.log"
Jul 23 18:03:07.288212 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:07.288182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:03:07.288577 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:07.288322    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:03:07.288577 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:07.288338    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cb44f59f5-r5m9h: secret "image-registry-tls" not found
Jul 23 18:03:07.288577 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:07.288385    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls podName:7bb764f9-da0d-4905-80e6-276f7ac7ab39 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:23.288371815 +0000 UTC m=+65.701074581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls") pod "image-registry-cb44f59f5-r5m9h" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39") : secret "image-registry-tls" not found
Jul 23 18:03:07.389013 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:07.388989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:03:07.389151 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:07.389136    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:03:07.389192 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:07.389187    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls podName:b32355be-6a39-4b3f-95e0-8b320036a69c nodeName:}" failed. No retries permitted until 2026-07-23 18:03:23.389173167 +0000 UTC m=+65.801875947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls") pod "dns-default-tfhcq" (UID: "b32355be-6a39-4b3f-95e0-8b320036a69c") : secret "dns-default-metrics-tls" not found
Jul 23 18:03:10.008723 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:10.008688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:10.009097 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:10.008738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:10.009097 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:10.008848    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:10.009097 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:10.008922    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls podName:c69a7cbc-a579-410e-b848-68d5ff435526 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:18.008908558 +0000 UTC m=+60.421611324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frb6w" (UID: "c69a7cbc-a579-410e-b848-68d5ff435526") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:10.009237 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:10.009216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c69a7cbc-a579-410e-b848-68d5ff435526-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:12.228365 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:12.228328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:03:12.228915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:12.228435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:03:12.228915 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:12.228479    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:03:12.228915 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:03:12.228563    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls podName:58a9230c-14ed-451a-b8e8-80e0571e4475 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:28.228547478 +0000 UTC m=+70.641250243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gwt8v" (UID: "58a9230c-14ed-451a-b8e8-80e0571e4475") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:03:12.230872 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:12.230849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0045132-f8e8-45ec-b685-aa0d607941ad-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nkvwp\" (UID: \"a0045132-f8e8-45ec-b685-aa0d607941ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:03:12.266284 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:12.266254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"
Jul 23 18:03:12.385267 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:12.385181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp"]
Jul 23 18:03:13.316919 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:13.316876    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp" event={"ID":"a0045132-f8e8-45ec-b685-aa0d607941ad","Type":"ContainerStarted","Data":"585a9c2db7ad9fe16ed9778dde7fc1f4466b8664414481d10d804e58653331c4"}
Jul 23 18:03:15.324833 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:15.324795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp" event={"ID":"a0045132-f8e8-45ec-b685-aa0d607941ad","Type":"ContainerStarted","Data":"b7ce7b0072d10db31f93c3b88b8a9e828deb453178f36fac7dfe56fcc7080271"}
Jul 23 18:03:15.325182 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:15.324848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp" event={"ID":"a0045132-f8e8-45ec-b685-aa0d607941ad","Type":"ContainerStarted","Data":"55d5c40e2b8bcd489dca4cc9ccec704fcdffcad0889fdf56e5be222f92b48c9e"}
Jul 23 18:03:15.344554 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:15.344501    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nkvwp" podStartSLOduration=17.487793091 podStartE2EDuration="19.344484669s" totalImagesPullingTime="1.856691578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:15.343885678 +0000 UTC m=+57.756588480" watchObservedRunningTime="2026-07-23 18:03:15.344484669 +0000 UTC m=+57.757187457"
Jul 23 18:03:17.239652 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:17.239627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj4kk"
Jul 23 18:03:18.073213 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:18.073183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:18.075555 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:18.075531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c69a7cbc-a579-410e-b848-68d5ff435526-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frb6w\" (UID: \"c69a7cbc-a579-410e-b848-68d5ff435526\") " pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:18.160428 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:18.160396    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtwn7\""
Jul 23 18:03:18.167322 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:18.167300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frb6w"
Jul 23 18:03:18.289926 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:18.289895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frb6w"]
Jul 23 18:03:18.294056 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:18.294031    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69a7cbc_a579_410e_b848_68d5ff435526.slice/crio-06457de7257dd0c73c2be855e6400ca1037a071b8fdc2bd743aa08b3098201a5 WatchSource:0}: Error finding container 06457de7257dd0c73c2be855e6400ca1037a071b8fdc2bd743aa08b3098201a5: Status 404 returned error can't find the container with id 06457de7257dd0c73c2be855e6400ca1037a071b8fdc2bd743aa08b3098201a5
Jul 23 18:03:18.336469 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:18.336394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frb6w" event={"ID":"c69a7cbc-a579-410e-b848-68d5ff435526","Type":"ContainerStarted","Data":"06457de7257dd0c73c2be855e6400ca1037a071b8fdc2bd743aa08b3098201a5"}
Jul 23 18:03:22.809860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.809826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:03:22.810299 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.809905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:03:22.815374 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.815357    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:03:22.816273 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.816259    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:03:22.822194 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.822165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b4e3eef-9fac-4b55-ad64-b51b68d72ba7-original-pull-secret\") pod \"global-pull-secret-syncer-mxhw6\" (UID: \"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7\") " pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:03:22.822301 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.822254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0636b89a-e0b6-48ef-88b8-2df4c707dbbd-metrics-certs\") pod \"network-metrics-daemon-9stdm\" (UID: \"0636b89a-e0b6-48ef-88b8-2df4c707dbbd\") " pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:03:22.832681 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.832663    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqhz\""
Jul 23 18:03:22.835780 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.835765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxhw6"
Jul 23 18:03:22.837794 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.837777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9stdm"
Jul 23 18:03:22.910653 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.910635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:03:22.913539 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.913521    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 18:03:22.923457 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.923437    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 18:03:22.933772 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:22.933754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbdd\" (UniqueName: \"kubernetes.io/projected/e3b774d9-ac6b-4652-91cc-1757db758b5f-kube-api-access-rsbdd\") pod \"network-check-target-qms52\" (UID: \"e3b774d9-ac6b-4652-91cc-1757db758b5f\") " pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:03:23.143795 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.143726    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbpx\""
Jul 23 18:03:23.151048 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.151019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:03:23.314007 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.313974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:03:23.316869 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.316842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"image-registry-cb44f59f5-r5m9h\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") " pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:03:23.414434 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.414355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:03:23.416566 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.416538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32355be-6a39-4b3f-95e0-8b320036a69c-metrics-tls\") pod \"dns-default-tfhcq\" (UID: \"b32355be-6a39-4b3f-95e0-8b320036a69c\") " pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:03:23.595250 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.595202    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7nzjz\""
Jul 23 18:03:23.602729 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.602705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:03:23.604313 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.604288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vl72\""
Jul 23 18:03:23.612480 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.612461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:03:23.890680 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:23.890617    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qms52"]
Jul 23 18:03:23.894850 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:23.894825    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b774d9_ac6b_4652_91cc_1757db758b5f.slice/crio-f1945b67028d102899def5f600a4e3e8e1a2a98f0f3e88ee55ac08edc24fb75d WatchSource:0}: Error finding container f1945b67028d102899def5f600a4e3e8e1a2a98f0f3e88ee55ac08edc24fb75d: Status 404 returned error can't find the container with id f1945b67028d102899def5f600a4e3e8e1a2a98f0f3e88ee55ac08edc24fb75d
Jul 23 18:03:24.071558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.071533    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9stdm"]
Jul 23 18:03:24.080300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.079916    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxhw6"]
Jul 23 18:03:24.081577 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:24.081556    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4e3eef_9fac_4b55_ad64_b51b68d72ba7.slice/crio-89fa08b4c8751a10251e78ac3927232deabcaf2efc047f6ee7ad399e0bd870fe WatchSource:0}: Error finding container 89fa08b4c8751a10251e78ac3927232deabcaf2efc047f6ee7ad399e0bd870fe: Status 404 returned error can't find the container with id 89fa08b4c8751a10251e78ac3927232deabcaf2efc047f6ee7ad399e0bd870fe
Jul 23 18:03:24.119250 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:24.119209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32355be_6a39_4b3f_95e0_8b320036a69c.slice/crio-f5621fe0b81ae54934c3048bde6755e7366ab2f5872c9a3f6e5022bb0d6de8bd WatchSource:0}: Error finding container f5621fe0b81ae54934c3048bde6755e7366ab2f5872c9a3f6e5022bb0d6de8bd: Status 404 returned error can't find the container with id f5621fe0b81ae54934c3048bde6755e7366ab2f5872c9a3f6e5022bb0d6de8bd
Jul 23 18:03:24.121381 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.121362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tfhcq"]
Jul 23 18:03:24.121476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.121440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb44f59f5-r5m9h"]
Jul 23 18:03:24.122957 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:24.122924    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb764f9_da0d_4905_80e6_276f7ac7ab39.slice/crio-4114799cf069537af50988b6259fda70d44bb1512cc953af17279733d2519c58 WatchSource:0}: Error finding container 4114799cf069537af50988b6259fda70d44bb1512cc953af17279733d2519c58: Status 404 returned error can't find the container with id 4114799cf069537af50988b6259fda70d44bb1512cc953af17279733d2519c58
Jul 23 18:03:24.357023 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.356937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfhcq" event={"ID":"b32355be-6a39-4b3f-95e0-8b320036a69c","Type":"ContainerStarted","Data":"f5621fe0b81ae54934c3048bde6755e7366ab2f5872c9a3f6e5022bb0d6de8bd"}
Jul 23 18:03:24.358483 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.358461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frb6w" event={"ID":"c69a7cbc-a579-410e-b848-68d5ff435526","Type":"ContainerStarted","Data":"0d8866f198b2d520614a285f134e88bc412fa59aef5c55ddcda1576ce9568045"}
Jul 23 18:03:24.359712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.359687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxhw6" event={"ID":"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7","Type":"ContainerStarted","Data":"89fa08b4c8751a10251e78ac3927232deabcaf2efc047f6ee7ad399e0bd870fe"}
Jul 23 18:03:24.361120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.361098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" event={"ID":"7bb764f9-da0d-4905-80e6-276f7ac7ab39","Type":"ContainerStarted","Data":"cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d"}
Jul 23 18:03:24.361219 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.361137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" event={"ID":"7bb764f9-da0d-4905-80e6-276f7ac7ab39","Type":"ContainerStarted","Data":"4114799cf069537af50988b6259fda70d44bb1512cc953af17279733d2519c58"}
Jul 23 18:03:24.361298 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.361282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:03:24.362144 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.362122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qms52" event={"ID":"e3b774d9-ac6b-4652-91cc-1757db758b5f","Type":"ContainerStarted","Data":"f1945b67028d102899def5f600a4e3e8e1a2a98f0f3e88ee55ac08edc24fb75d"}
Jul 23 18:03:24.363118 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.363101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9stdm" event={"ID":"0636b89a-e0b6-48ef-88b8-2df4c707dbbd","Type":"ContainerStarted","Data":"4ebee5de027675e96032468a775a0f992400d4e71cfb68037377b88847b0ec9d"}
Jul 23 18:03:24.382374 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:24.382335    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" podStartSLOduration=65.382322861 podStartE2EDuration="1m5.382322861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:24.381300597 +0000 UTC m=+66.794003385" watchObservedRunningTime="2026-07-23 18:03:24.382322861 +0000 UTC m=+66.795025649"
Jul 23 18:03:25.249094 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.249064    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"]
Jul 23 18:03:25.252621 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.252525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.257777 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.256818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 18:03:25.257777 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.257063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 18:03:25.257777 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.257279    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 18:03:25.257777 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.257619    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 18:03:25.266113 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.265087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"]
Jul 23 18:03:25.331208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.330923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4dc28c9-52fd-404e-b72f-7c738edd16be-tmp\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.331208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.331048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c4dc28c9-52fd-404e-b72f-7c738edd16be-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.331208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.331076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cwk\" (UniqueName: \"kubernetes.io/projected/c4dc28c9-52fd-404e-b72f-7c738edd16be-kube-api-access-j4cwk\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.333832 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.333285    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-n7dn5"]
Jul 23 18:03:25.336243 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.335650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:25.340823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.340629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 18:03:25.341040 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.341022    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 18:03:25.341674 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.341650    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bs9lz\""
Jul 23 18:03:25.355312 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.354969    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-n7dn5"]
Jul 23 18:03:25.432289 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.432258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c4dc28c9-52fd-404e-b72f-7c738edd16be-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.432458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.432307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62kw\" (UniqueName: \"kubernetes.io/projected/e9ad958d-7fe3-4384-bd97-a16d6ee756ed-kube-api-access-d62kw\") pod \"downloads-5bc67dcd46-n7dn5\" (UID: \"e9ad958d-7fe3-4384-bd97-a16d6ee756ed\") " pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:25.432458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.432335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cwk\" (UniqueName: \"kubernetes.io/projected/c4dc28c9-52fd-404e-b72f-7c738edd16be-kube-api-access-j4cwk\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.434088 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.433315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4dc28c9-52fd-404e-b72f-7c738edd16be-tmp\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.434088 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.434050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4dc28c9-52fd-404e-b72f-7c738edd16be-tmp\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.437257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.437218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c4dc28c9-52fd-404e-b72f-7c738edd16be-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.445485 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.445448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cwk\" (UniqueName: \"kubernetes.io/projected/c4dc28c9-52fd-404e-b72f-7c738edd16be-kube-api-access-j4cwk\") pod \"klusterlet-addon-workmgr-58f987648b-bh9hv\" (UID: \"c4dc28c9-52fd-404e-b72f-7c738edd16be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.534478 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.534446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62kw\" (UniqueName: \"kubernetes.io/projected/e9ad958d-7fe3-4384-bd97-a16d6ee756ed-kube-api-access-d62kw\") pod \"downloads-5bc67dcd46-n7dn5\" (UID: \"e9ad958d-7fe3-4384-bd97-a16d6ee756ed\") " pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:25.550794 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.550745    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62kw\" (UniqueName: \"kubernetes.io/projected/e9ad958d-7fe3-4384-bd97-a16d6ee756ed-kube-api-access-d62kw\") pod \"downloads-5bc67dcd46-n7dn5\" (UID: \"e9ad958d-7fe3-4384-bd97-a16d6ee756ed\") " pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:25.573218 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.573069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:25.651937 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.651907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:25.785477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.784691    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"]
Jul 23 18:03:25.795520 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:25.795479    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4dc28c9_52fd_404e_b72f_7c738edd16be.slice/crio-aa18dee758443be1c2deee65f9e1e924036f2169d387efd020debde5f98f3b6c WatchSource:0}: Error finding container aa18dee758443be1c2deee65f9e1e924036f2169d387efd020debde5f98f3b6c: Status 404 returned error can't find the container with id aa18dee758443be1c2deee65f9e1e924036f2169d387efd020debde5f98f3b6c
Jul 23 18:03:25.874388 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:25.874306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-n7dn5"]
Jul 23 18:03:25.879114 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:25.879070    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ad958d_7fe3_4384_bd97_a16d6ee756ed.slice/crio-5d3575e5d0624ee8abb97f82008ca5eef8b8220a46259e2d9c4445ee78ceaa01 WatchSource:0}: Error finding container 5d3575e5d0624ee8abb97f82008ca5eef8b8220a46259e2d9c4445ee78ceaa01: Status 404 returned error can't find the container with id 5d3575e5d0624ee8abb97f82008ca5eef8b8220a46259e2d9c4445ee78ceaa01
Jul 23 18:03:26.377659 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:26.377622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9stdm" event={"ID":"0636b89a-e0b6-48ef-88b8-2df4c707dbbd","Type":"ContainerStarted","Data":"dff50b8cb8096098a1efceb87fa306562d1d8135ac3f41d5243c1838ffab2866"}
Jul 23 18:03:26.378109 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:26.377688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9stdm" event={"ID":"0636b89a-e0b6-48ef-88b8-2df4c707dbbd","Type":"ContainerStarted","Data":"8ecc9f2aa12674da2b8d83124192983335cea18e169c04e0749b19f33fd38e6b"}
Jul 23 18:03:26.380843 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:26.380769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-n7dn5" event={"ID":"e9ad958d-7fe3-4384-bd97-a16d6ee756ed","Type":"ContainerStarted","Data":"5d3575e5d0624ee8abb97f82008ca5eef8b8220a46259e2d9c4445ee78ceaa01"}
Jul 23 18:03:26.383205 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:26.383154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv" event={"ID":"c4dc28c9-52fd-404e-b72f-7c738edd16be","Type":"ContainerStarted","Data":"aa18dee758443be1c2deee65f9e1e924036f2169d387efd020debde5f98f3b6c"}
Jul 23 18:03:26.397166 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:26.396882    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9stdm" podStartSLOduration=67.082510505 podStartE2EDuration="1m8.396864694s" totalImagesPullingTime="1.314354189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:26.396174376 +0000 UTC m=+68.808877166" watchObservedRunningTime="2026-07-23 18:03:26.396864694 +0000 UTC m=+68.809567484"
Jul 23 18:03:27.391963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:27.391391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfhcq" event={"ID":"b32355be-6a39-4b3f-95e0-8b320036a69c","Type":"ContainerStarted","Data":"cf799bb680bf71b5178a205a16af696f94be36402159b4f9a5ead9b14c6d1779"}
Jul 23 18:03:27.391963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:27.391530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tfhcq" event={"ID":"b32355be-6a39-4b3f-95e0-8b320036a69c","Type":"ContainerStarted","Data":"a3ac031486cb862e381c4094824ac61ee3b5ac2a136b51f2c7d52d8e7ede70bd"}
Jul 23 18:03:27.411321 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:27.411265    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tfhcq" podStartSLOduration=33.650253315 podStartE2EDuration="36.411246373s" totalImagesPullingTime="2.760993058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:27.409902139 +0000 UTC m=+69.822604950" watchObservedRunningTime="2026-07-23 18:03:27.411246373 +0000 UTC m=+69.823949166"
Jul 23 18:03:28.264431 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:28.264336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:03:28.267394 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:28.267366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/58a9230c-14ed-451a-b8e8-80e0571e4475-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gwt8v\" (UID: \"58a9230c-14ed-451a-b8e8-80e0571e4475\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:03:28.397498 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:28.397458    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:03:28.511920 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:28.511883    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jr4hr\""
Jul 23 18:03:28.519507 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:28.519441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"
Jul 23 18:03:32.883426 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:32.883375    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v"]
Jul 23 18:03:32.890353 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:32.890318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a9230c_14ed_451a_b8e8_80e0571e4475.slice/crio-3a7161e4a8430a7eae9227b7412abea91310ce9c2345fb0ebd9823880c6c50cd WatchSource:0}: Error finding container 3a7161e4a8430a7eae9227b7412abea91310ce9c2345fb0ebd9823880c6c50cd: Status 404 returned error can't find the container with id 3a7161e4a8430a7eae9227b7412abea91310ce9c2345fb0ebd9823880c6c50cd
Jul 23 18:03:33.424828 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.424793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frb6w" event={"ID":"c69a7cbc-a579-410e-b848-68d5ff435526","Type":"ContainerStarted","Data":"9ce9011a3257daff7a04fd7d7793b45aed6b7821e4fe7abb7639e8cb34a547b1"}
Jul 23 18:03:33.428188 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.428099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxhw6" event={"ID":"3b4e3eef-9fac-4b55-ad64-b51b68d72ba7","Type":"ContainerStarted","Data":"741f768672a16dfdac49f5f6d78cb6a7ea2bda992bdd31ffa09f5dbefd6b5c71"}
Jul 23 18:03:33.431001 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.430973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qms52" event={"ID":"e3b774d9-ac6b-4652-91cc-1757db758b5f","Type":"ContainerStarted","Data":"434215ff84c7af8367eb8f10f19f710b5edbae729c3ef009509d2c7b231ec373"}
Jul 23 18:03:33.431462 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.431441    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:03:33.434123 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.434098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v" event={"ID":"58a9230c-14ed-451a-b8e8-80e0571e4475","Type":"ContainerStarted","Data":"3a7161e4a8430a7eae9227b7412abea91310ce9c2345fb0ebd9823880c6c50cd"}
Jul 23 18:03:33.465132 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.464485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qms52" podStartSLOduration=66.687325872 podStartE2EDuration="1m15.464465704s" totalImagesPullingTime="8.777139832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:33.462868093 +0000 UTC m=+75.875570881" watchObservedRunningTime="2026-07-23 18:03:33.464465704 +0000 UTC m=+75.877168495"
Jul 23 18:03:33.465132 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:33.465011    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mxhw6" podStartSLOduration=65.841339839 podStartE2EDuration="1m14.465001912s" totalImagesPullingTime="8.623662073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:33.446122775 +0000 UTC m=+75.858825561" watchObservedRunningTime="2026-07-23 18:03:33.465001912 +0000 UTC m=+75.877704703"
Jul 23 18:03:34.244045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.243491    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f94ddbdf-7x42p"]
Jul 23 18:03:34.251004 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.250431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.253674 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.253651    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 18:03:34.254931 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.254913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 18:03:34.255060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.254987    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 18:03:34.255960 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.255168    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 18:03:34.255960 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.255212    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-djpzv\""
Jul 23 18:03:34.255960 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.255493    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 18:03:34.258510 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.257384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f94ddbdf-7x42p"]
Jul 23 18:03:34.317085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.317050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-oauth-config\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.317262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.317112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-oauth-serving-cert\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.317262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.317195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-service-ca\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.317262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.317230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcks9\" (UniqueName: \"kubernetes.io/projected/2f02f29e-e977-41d5-8d03-0562dcc1f86c-kube-api-access-bcks9\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.317452 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.317275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-serving-cert\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.317452 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.317292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-config\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.418343 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.418289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-oauth-serving-cert\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.418547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.418349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-service-ca\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.418547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.418374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcks9\" (UniqueName: \"kubernetes.io/projected/2f02f29e-e977-41d5-8d03-0562dcc1f86c-kube-api-access-bcks9\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.418547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.418432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-serving-cert\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.418547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.418455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-config\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.418547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.418504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-oauth-config\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.421043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.419807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-oauth-serving-cert\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.421043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.420397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-service-ca\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.421043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.420994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-config\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.422482 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.421926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-serving-cert\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.424373 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.424335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-oauth-config\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.434011 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.433969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcks9\" (UniqueName: \"kubernetes.io/projected/2f02f29e-e977-41d5-8d03-0562dcc1f86c-kube-api-access-bcks9\") pod \"console-59f94ddbdf-7x42p\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") " pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:34.564398 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:34.564356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:38.404501 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:38.404463    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tfhcq"
Jul 23 18:03:43.608105 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:43.607970    2578 patch_prober.go:28] interesting pod/image-registry-cb44f59f5-r5m9h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 18:03:43.608105 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:43.608032    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" podUID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:03:45.373085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:45.373058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:03:45.683693 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:45.683588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f94ddbdf-7x42p"]
Jul 23 18:03:46.145842 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:46.145808    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f02f29e_e977_41d5_8d03_0562dcc1f86c.slice/crio-a5483a8187743e721618db0c0195e27a7a8dc2df8a3679fbbff2bb1f0633abd1 WatchSource:0}: Error finding container a5483a8187743e721618db0c0195e27a7a8dc2df8a3679fbbff2bb1f0633abd1: Status 404 returned error can't find the container with id a5483a8187743e721618db0c0195e27a7a8dc2df8a3679fbbff2bb1f0633abd1
Jul 23 18:03:46.490297 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.490249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frb6w" event={"ID":"c69a7cbc-a579-410e-b848-68d5ff435526","Type":"ContainerStarted","Data":"c092955cff1875f260f98a9081c3404161ce0780cb53afa22231901e15bd5c56"}
Jul 23 18:03:46.491863 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.491831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f94ddbdf-7x42p" event={"ID":"2f02f29e-e977-41d5-8d03-0562dcc1f86c","Type":"ContainerStarted","Data":"a5483a8187743e721618db0c0195e27a7a8dc2df8a3679fbbff2bb1f0633abd1"}
Jul 23 18:03:46.493614 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.493580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-n7dn5" event={"ID":"e9ad958d-7fe3-4384-bd97-a16d6ee756ed","Type":"ContainerStarted","Data":"5a386f2927225cbccc91b35535b9fc3db8c959f732d3130f9aea87202a44c661"}
Jul 23 18:03:46.493829 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.493810    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:46.495484 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.495459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv" event={"ID":"c4dc28c9-52fd-404e-b72f-7c738edd16be","Type":"ContainerStarted","Data":"ba1415c798c78ebddbd1fdef11d0668e0088d5688ac4b7cd3c3c0f0f7b855854"}
Jul 23 18:03:46.495484 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.495478    2578 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-n7dn5 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused" start-of-body=
Jul 23 18:03:46.495591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.495509    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:46.495591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.495516    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-n7dn5" podUID="e9ad958d-7fe3-4384-bd97-a16d6ee756ed" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused"
Jul 23 18:03:46.497224 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.497174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv"
Jul 23 18:03:46.497721 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.497697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v" event={"ID":"58a9230c-14ed-451a-b8e8-80e0571e4475","Type":"ContainerStarted","Data":"ebc24dec2a01fa94cf23495167e241bf286791bd4e2e873fde179ae6ee0a4ad1"}
Jul 23 18:03:46.509237 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.509184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-frb6w" podStartSLOduration=16.850117013 podStartE2EDuration="44.509167422s" totalImagesPullingTime="27.659050409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:03:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:46.508082108 +0000 UTC m=+88.920784900" watchObservedRunningTime="2026-07-23 18:03:46.509167422 +0000 UTC m=+88.921870210"
Jul 23 18:03:46.526257 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.526199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-n7dn5" podStartSLOduration=1.262347061 podStartE2EDuration="21.52616814s" totalImagesPullingTime="20.263821079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:46.523659653 +0000 UTC m=+88.936362447" watchObservedRunningTime="2026-07-23 18:03:46.52616814 +0000 UTC m=+88.938870934"
Jul 23 18:03:46.541422 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.541333    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gwt8v" podStartSLOduration=37.039328027 podStartE2EDuration="50.541312125s" totalImagesPullingTime="13.501984098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:46.54068182 +0000 UTC m=+88.953384608" watchObservedRunningTime="2026-07-23 18:03:46.541312125 +0000 UTC m=+88.954014914"
Jul 23 18:03:46.559256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:46.558694    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f987648b-bh9hv" podStartSLOduration=1.215403687 podStartE2EDuration="21.558674139s" totalImagesPullingTime="20.343270452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:46.558099397 +0000 UTC m=+88.970802236" watchObservedRunningTime="2026-07-23 18:03:46.558674139 +0000 UTC m=+88.971376928"
Jul 23 18:03:47.515984 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:47.515743    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-n7dn5"
Jul 23 18:03:47.557324 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:47.557291    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cb44f59f5-r5m9h"]
Jul 23 18:03:50.518370 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:50.518283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f94ddbdf-7x42p" event={"ID":"2f02f29e-e977-41d5-8d03-0562dcc1f86c","Type":"ContainerStarted","Data":"25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7"}
Jul 23 18:03:50.536443 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:50.536377    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f94ddbdf-7x42p" podStartSLOduration=12.601090165 podStartE2EDuration="16.536359763s" totalImagesPullingTime="3.935269598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:50.536259564 +0000 UTC m=+92.948962355" watchObservedRunningTime="2026-07-23 18:03:50.536359763 +0000 UTC m=+92.949062555"
Jul 23 18:03:52.685458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:52.685420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f94ddbdf-7x42p"]
Jul 23 18:03:53.351376 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.351341    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mzpqh"]
Jul 23 18:03:53.390924 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.390893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.393683 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.393653    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 18:03:53.394752 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.394720    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 18:03:53.394752 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.394745    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 18:03:53.394933 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.394745    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 18:03:53.394933 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.394794    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fxzht\""
Jul 23 18:03:53.476088 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-textfile\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-tls\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1100232d-8e8d-4a05-aa82-1eca348910cc-metrics-client-ca\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-wtmp\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476352 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476352 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-root\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476352 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-sys\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.476523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.476391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvvx\" (UniqueName: \"kubernetes.io/projected/1100232d-8e8d-4a05-aa82-1eca348910cc-kube-api-access-4hvvx\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.576768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-root\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.576896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.576896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-sys\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.576896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvvx\" (UniqueName: \"kubernetes.io/projected/1100232d-8e8d-4a05-aa82-1eca348910cc-kube-api-access-4hvvx\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577059 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576865    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-root\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577059 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-textfile\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577059 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576942    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-sys\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577059 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-tls\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577059 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.576999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1100232d-8e8d-4a05-aa82-1eca348910cc-metrics-client-ca\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577059 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.577056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-wtmp\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577352 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.577090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577352 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.577248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-wtmp\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.577537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-textfile\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577742 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.577709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1100232d-8e8d-4a05-aa82-1eca348910cc-metrics-client-ca\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.577842 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.577597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.579906 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.579883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-tls\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.580000 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.579977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1100232d-8e8d-4a05-aa82-1eca348910cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.585635 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.585611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvvx\" (UniqueName: \"kubernetes.io/projected/1100232d-8e8d-4a05-aa82-1eca348910cc-kube-api-access-4hvvx\") pod \"node-exporter-mzpqh\" (UID: \"1100232d-8e8d-4a05-aa82-1eca348910cc\") " pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.702313 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:53.702243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzpqh"
Jul 23 18:03:53.727271 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:53.727238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1100232d_8e8d_4a05_aa82_1eca348910cc.slice/crio-9e9dc9226be45690049894494366280c89d888b2d0437777e4c5f4e64c61720e WatchSource:0}: Error finding container 9e9dc9226be45690049894494366280c89d888b2d0437777e4c5f4e64c61720e: Status 404 returned error can't find the container with id 9e9dc9226be45690049894494366280c89d888b2d0437777e4c5f4e64c61720e
Jul 23 18:03:54.546850 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:54.546770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzpqh" event={"ID":"1100232d-8e8d-4a05-aa82-1eca348910cc","Type":"ContainerStarted","Data":"9e9dc9226be45690049894494366280c89d888b2d0437777e4c5f4e64c61720e"}
Jul 23 18:03:54.565018 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:54.564987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:03:56.355824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.355791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"]
Jul 23 18:03:56.373447 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.373422    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.374802 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.374777    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"]
Jul 23 18:03:56.376588 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.376566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-drfibel976u6s\""
Jul 23 18:03:56.376800 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.376585    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hspcn\""
Jul 23 18:03:56.376915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.376585    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 23 18:03:56.376915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.376607    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 23 18:03:56.377008 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.376654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 23 18:03:56.377008 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.376654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 23 18:03:56.377767 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.377750    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 23 18:03:56.393124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c266fff-43ce-49a6-bef4-2c0db59362a6-metrics-client-ca\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393214 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-tls\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393214 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393214 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-grpc-tls\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393331 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393331 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393331 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzsrj\" (UniqueName: \"kubernetes.io/projected/3c266fff-43ce-49a6-bef4-2c0db59362a6-kube-api-access-tzsrj\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.393331 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.393294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494061 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c266fff-43ce-49a6-bef4-2c0db59362a6-metrics-client-ca\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-tls\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-grpc-tls\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494453 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494519 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494519 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzsrj\" (UniqueName: \"kubernetes.io/projected/3c266fff-43ce-49a6-bef4-2c0db59362a6-kube-api-access-tzsrj\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494616 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.494761 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.494735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c266fff-43ce-49a6-bef4-2c0db59362a6-metrics-client-ca\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.496830 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.496803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.497056 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.497027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-tls\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.497246 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.497207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-grpc-tls\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.497318 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.497208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.497318 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.497234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.497466 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.497448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c266fff-43ce-49a6-bef4-2c0db59362a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.504590 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.504568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzsrj\" (UniqueName: \"kubernetes.io/projected/3c266fff-43ce-49a6-bef4-2c0db59362a6-kube-api-access-tzsrj\") pod \"thanos-querier-5df8c9dd69-fd5gd\" (UID: \"3c266fff-43ce-49a6-bef4-2c0db59362a6\") " pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.555333 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.555299    2578 generic.go:356] "Generic (PLEG): container finished" podID="1100232d-8e8d-4a05-aa82-1eca348910cc" containerID="b68f51313f6eaa9e6718209620b6c529536171396b28fdecd9ff1af667914f21" exitCode=0
Jul 23 18:03:56.555443 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.555373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzpqh" event={"ID":"1100232d-8e8d-4a05-aa82-1eca348910cc","Type":"ContainerDied","Data":"b68f51313f6eaa9e6718209620b6c529536171396b28fdecd9ff1af667914f21"}
Jul 23 18:03:56.686348 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.686325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:03:56.844740 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:56.844706    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"]
Jul 23 18:03:56.848448 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:56.848418    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c266fff_43ce_49a6_bef4_2c0db59362a6.slice/crio-c58bf9269e4567d86aaa4e5139dec38f24f5afe0bf09347324e1ec76b0e3567e WatchSource:0}: Error finding container c58bf9269e4567d86aaa4e5139dec38f24f5afe0bf09347324e1ec76b0e3567e: Status 404 returned error can't find the container with id c58bf9269e4567d86aaa4e5139dec38f24f5afe0bf09347324e1ec76b0e3567e
Jul 23 18:03:57.560997 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.560964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"c58bf9269e4567d86aaa4e5139dec38f24f5afe0bf09347324e1ec76b0e3567e"}
Jul 23 18:03:57.563450 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.563423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzpqh" event={"ID":"1100232d-8e8d-4a05-aa82-1eca348910cc","Type":"ContainerStarted","Data":"acdb0f439c788381ac9b30b4235507e24ad83ad5775d5ed1a776ffda33b753c4"}
Jul 23 18:03:57.563570 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.563467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzpqh" event={"ID":"1100232d-8e8d-4a05-aa82-1eca348910cc","Type":"ContainerStarted","Data":"efbdd534f79acc841ab62c00cdeae6303c3f251368ca516a333a539aeaad87eb"}
Jul 23 18:03:57.586174 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.586130    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mzpqh" podStartSLOduration=2.7168247389999998 podStartE2EDuration="4.586115106s" totalImagesPullingTime="1.738273692s" totalInitContainerRuntime="131.016675ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:57.585809316 +0000 UTC m=+99.998512106" watchObservedRunningTime="2026-07-23 18:03:57.586115106 +0000 UTC m=+99.998817898"
Jul 23 18:03:57.763911 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.763878    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"]
Jul 23 18:03:57.788703 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.788674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"]
Jul 23 18:03:57.788849 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.788796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.791824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.791802    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 18:03:57.791950 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.791824    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 18:03:57.791950 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.791811    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lp6js\""
Jul 23 18:03:57.792247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.792226    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 18:03:57.792589 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.792571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-930t6n3abpjdu\""
Jul 23 18:03:57.792662 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.792642    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 18:03:57.804727 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59148476-a601-4373-8336-a8e488f12450-metrics-server-audit-profiles\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.804831 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-secret-metrics-server-tls\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.804831 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59148476-a601-4373-8336-a8e488f12450-audit-log\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.804831 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-client-ca-bundle\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.804970 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j2xl\" (UniqueName: \"kubernetes.io/projected/59148476-a601-4373-8336-a8e488f12450-kube-api-access-5j2xl\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.804970 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59148476-a601-4373-8336-a8e488f12450-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.805047 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.804972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-secret-metrics-server-client-certs\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905425 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59148476-a601-4373-8336-a8e488f12450-metrics-server-audit-profiles\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905425 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-secret-metrics-server-tls\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905593 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59148476-a601-4373-8336-a8e488f12450-audit-log\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905593 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-client-ca-bundle\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905593 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j2xl\" (UniqueName: \"kubernetes.io/projected/59148476-a601-4373-8336-a8e488f12450-kube-api-access-5j2xl\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905593 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59148476-a601-4373-8336-a8e488f12450-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.905794 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.905597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-secret-metrics-server-client-certs\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.906056 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.906026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59148476-a601-4373-8336-a8e488f12450-audit-log\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.906471 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.906447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59148476-a601-4373-8336-a8e488f12450-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.906572 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.906497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59148476-a601-4373-8336-a8e488f12450-metrics-server-audit-profiles\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.908590 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.908548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-secret-metrics-server-tls\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.908876 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.908857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-client-ca-bundle\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.908943 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.908902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59148476-a601-4373-8336-a8e488f12450-secret-metrics-server-client-certs\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:57.925969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:57.925946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j2xl\" (UniqueName: \"kubernetes.io/projected/59148476-a601-4373-8336-a8e488f12450-kube-api-access-5j2xl\") pod \"metrics-server-86dd4ff6fd-krgrl\" (UID: \"59148476-a601-4373-8336-a8e488f12450\") " pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:58.099695 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.099659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:03:58.161877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.161428    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"]
Jul 23 18:03:58.174282 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.174258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.179969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.178804    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"]
Jul 23 18:03:58.179969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.178874    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 18:03:58.179969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.179747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k5nbj\""
Jul 23 18:03:58.208895 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.208867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcxht\" (UniqueName: \"kubernetes.io/projected/52d73c32-4eb7-43ca-bdd2-eeb560826322-kube-api-access-qcxht\") pod \"monitoring-plugin-7b7b7bc8bf-z7k7w\" (UID: \"52d73c32-4eb7-43ca-bdd2-eeb560826322\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.209006 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.208911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52d73c32-4eb7-43ca-bdd2-eeb560826322-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z7k7w\" (UID: \"52d73c32-4eb7-43ca-bdd2-eeb560826322\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.261260 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.261234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"]
Jul 23 18:03:58.309456 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.309399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcxht\" (UniqueName: \"kubernetes.io/projected/52d73c32-4eb7-43ca-bdd2-eeb560826322-kube-api-access-qcxht\") pod \"monitoring-plugin-7b7b7bc8bf-z7k7w\" (UID: \"52d73c32-4eb7-43ca-bdd2-eeb560826322\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.309569 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.309485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52d73c32-4eb7-43ca-bdd2-eeb560826322-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z7k7w\" (UID: \"52d73c32-4eb7-43ca-bdd2-eeb560826322\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.312204 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.312180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52d73c32-4eb7-43ca-bdd2-eeb560826322-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z7k7w\" (UID: \"52d73c32-4eb7-43ca-bdd2-eeb560826322\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.318957 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.318937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcxht\" (UniqueName: \"kubernetes.io/projected/52d73c32-4eb7-43ca-bdd2-eeb560826322-kube-api-access-qcxht\") pod \"monitoring-plugin-7b7b7bc8bf-z7k7w\" (UID: \"52d73c32-4eb7-43ca-bdd2-eeb560826322\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.489963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.489881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:03:58.760362 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:58.760296    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59148476_a601_4373_8336_a8e488f12450.slice/crio-df075705390ef1068442a2b7f3488d36ae59807fc8162585fb63ce7021ae67f9 WatchSource:0}: Error finding container df075705390ef1068442a2b7f3488d36ae59807fc8162585fb63ce7021ae67f9: Status 404 returned error can't find the container with id df075705390ef1068442a2b7f3488d36ae59807fc8162585fb63ce7021ae67f9
Jul 23 18:03:58.882575 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:58.882541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"]
Jul 23 18:03:58.885510 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:03:58.885481    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d73c32_4eb7_43ca_bdd2_eeb560826322.slice/crio-7974333f3b400c10d2b9efba4bd7d11cea5f345f90b2653f45821140adbdd259 WatchSource:0}: Error finding container 7974333f3b400c10d2b9efba4bd7d11cea5f345f90b2653f45821140adbdd259: Status 404 returned error can't find the container with id 7974333f3b400c10d2b9efba4bd7d11cea5f345f90b2653f45821140adbdd259
Jul 23 18:03:59.573326 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.573277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w" event={"ID":"52d73c32-4eb7-43ca-bdd2-eeb560826322","Type":"ContainerStarted","Data":"7974333f3b400c10d2b9efba4bd7d11cea5f345f90b2653f45821140adbdd259"}
Jul 23 18:03:59.574974 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.574932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl" event={"ID":"59148476-a601-4373-8336-a8e488f12450","Type":"ContainerStarted","Data":"df075705390ef1068442a2b7f3488d36ae59807fc8162585fb63ce7021ae67f9"}
Jul 23 18:03:59.577254 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.577229    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 18:03:59.592038 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.592005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"d9cf2a58ba10c1ca395f4bf7af1b848fc7f8f314c4c645ebd35876fb89c14a6f"}
Jul 23 18:03:59.592139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.592098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"24ec365b0cb91dbdee77755fe67626717e8d3021b3eb4021696822de681bfb46"}
Jul 23 18:03:59.592139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.592136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"733ecb969dfd8952770674fae1e989389d19ae05b664814aab188ea7e6aa53c1"}
Jul 23 18:03:59.592268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.592245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.597994 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.597948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 18:03:59.598198 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 18:03:59.598277 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 18:03:59.598277 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598244    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 18:03:59.598378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598298    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 18:03:59.598378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 18:03:59.598570 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 18:03:59.598651 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.598638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 18:03:59.599024 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.599008    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ambu4uidmlrj\""
Jul 23 18:03:59.599296 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.599274    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 18:03:59.599397 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.599384    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5dzq5\""
Jul 23 18:03:59.599557 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.599520    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 18:03:59.600178 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.599961    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 18:03:59.600178 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.600014    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 18:03:59.605358 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.605341    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 18:03:59.619853 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.619802    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 18:03:59.620941 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.620923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.620956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-config\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.620979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-web-config\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-config-out\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621601 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621601 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621601 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621601 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621761 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.621761 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.621632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqjl\" (UniqueName: \"kubernetes.io/projected/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-kube-api-access-2fqjl\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.629825 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.629803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 18:03:59.722268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-config\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-web-config\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-config-out\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.722877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqjl\" (UniqueName: \"kubernetes.io/projected/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-kube-api-access-2fqjl\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.723365 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.722907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.723365 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.723068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.723365 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.723169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.723635 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.723542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.724903 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.724559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.725527 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.725112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.727002 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.726982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.727169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.727145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.727971 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.727947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.728090 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.728064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.728300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.728276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-config\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.728388 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.728277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.728509 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.728490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.728900 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.728875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.729105 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.729029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.729338 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.729315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.729477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.729389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-web-config\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.730110 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.730065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-config-out\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.730331 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.730308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.731238 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.731213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.734042 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.734021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqjl\" (UniqueName: \"kubernetes.io/projected/c98a8a7b-d11d-40fa-b413-c8a0776a0f37-kube-api-access-2fqjl\") pod \"prometheus-k8s-0\" (UID: \"c98a8a7b-d11d-40fa-b413-c8a0776a0f37\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:03:59.904523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:03:59.904392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:04:00.087967 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:00.087849    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 18:04:00.516356 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:04:00.516319    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98a8a7b_d11d_40fa_b413_c8a0776a0f37.slice/crio-6b9b93ad8ef2fe8bdd6eb2753d795e9119be196670a1092785c63174df15f250 WatchSource:0}: Error finding container 6b9b93ad8ef2fe8bdd6eb2753d795e9119be196670a1092785c63174df15f250: Status 404 returned error can't find the container with id 6b9b93ad8ef2fe8bdd6eb2753d795e9119be196670a1092785c63174df15f250
Jul 23 18:04:00.583181 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:00.583142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"6b9b93ad8ef2fe8bdd6eb2753d795e9119be196670a1092785c63174df15f250"}
Jul 23 18:04:02.592541 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.592506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl" event={"ID":"59148476-a601-4373-8336-a8e488f12450","Type":"ContainerStarted","Data":"4e71a69c08a5390739e53076fddaecf949d0f95a1c2efcc71c41be4b22ae1358"}
Jul 23 18:04:02.595490 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.595463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"8ea26e24c7e9c4df0522c0effcf14f63e05882723a19b51e031105b7e2950922"}
Jul 23 18:04:02.595589 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.595531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"26dde17d15d86e96ed1ca8c7e457a7f5c55cadb26916f38d2ef58f217938f2a0"}
Jul 23 18:04:02.595589 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.595572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" event={"ID":"3c266fff-43ce-49a6-bef4-2c0db59362a6","Type":"ContainerStarted","Data":"fb9dcabf3ba75c29f2a9afb3ba366852a87056d0fc7047c312b9222b4326e3d9"}
Jul 23 18:04:02.595691 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.595618    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:04:02.596859 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.596833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w" event={"ID":"52d73c32-4eb7-43ca-bdd2-eeb560826322","Type":"ContainerStarted","Data":"867592d5749d39a943a0c27ec4a490ea73e54867180abf0887ca41bda4ea33a5"}
Jul 23 18:04:02.597044 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.597028    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:04:02.602904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.602884    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w"
Jul 23 18:04:02.616558 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.616523    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl" podStartSLOduration=2.666887818 podStartE2EDuration="5.616510085s" totalImagesPullingTime="2.949622267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:02.616085969 +0000 UTC m=+105.028788760" watchObservedRunningTime="2026-07-23 18:04:02.616510085 +0000 UTC m=+105.029212851"
Jul 23 18:04:02.647503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.647460    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z7k7w" podStartSLOduration=1.82140923 podStartE2EDuration="4.647442288s" totalImagesPullingTime="2.826033058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:02.646493395 +0000 UTC m=+105.059196188" watchObservedRunningTime="2026-07-23 18:04:02.647442288 +0000 UTC m=+105.060145077"
Jul 23 18:04:02.684360 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:02.684310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd" podStartSLOduration=2.117567109 podStartE2EDuration="6.684295265s" totalImagesPullingTime="4.566728156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:02.684057142 +0000 UTC m=+105.096759933" watchObservedRunningTime="2026-07-23 18:04:02.684295265 +0000 UTC m=+105.096998053"
Jul 23 18:04:03.602353 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:03.602313    2578 generic.go:356] "Generic (PLEG): container finished" podID="c98a8a7b-d11d-40fa-b413-c8a0776a0f37" containerID="d77eb58fb1207b719d60de3ed24e0bdd54751f3f536199cc62ffc1b2a80eb6ae" exitCode=0
Jul 23 18:04:03.602892 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:03.602433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerDied","Data":"d77eb58fb1207b719d60de3ed24e0bdd54751f3f536199cc62ffc1b2a80eb6ae"}
Jul 23 18:04:05.446700 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:05.446672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qms52"
Jul 23 18:04:07.623361 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:07.623336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"4e34347d369377bb482d77ba336228e5835137a3bca74da101a8d96e45755b7d"}
Jul 23 18:04:08.609611 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.609580    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5df8c9dd69-fd5gd"
Jul 23 18:04:08.630309 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.630280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"ad0b071c97b1fd348824f55150e51ffeb9ec0d5618e35cc4fe7b27495ed8da5a"}
Jul 23 18:04:08.630771 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.630346    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"c245ba54e4d005c97bc85838cb30e5eda7b07e16793a6685f8c3c26800a27ff5"}
Jul 23 18:04:08.630771 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.630394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"8671d0ee6e594155d2276b6c5ba11cbc1ff3e9e0e0bb4ddce1db7a8c826e4c1f"}
Jul 23 18:04:08.630771 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.630457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"d9d12066e1efcc7e2029d033ba327c758c68b546179e85051fad98cb32652772"}
Jul 23 18:04:08.630771 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.630501    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c98a8a7b-d11d-40fa-b413-c8a0776a0f37","Type":"ContainerStarted","Data":"419ffaf38bc0dc7b237132e7f4ab16395714ad8eb8da80ff7b62ae35bb4eee07"}
Jul 23 18:04:08.674401 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:08.674336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.645755683 podStartE2EDuration="9.674315275s" totalImagesPullingTime="6.007496757s" totalInitContainerRuntime="21.062835ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:08.672070479 +0000 UTC m=+111.084773289" watchObservedRunningTime="2026-07-23 18:04:08.674315275 +0000 UTC m=+111.087018064"
Jul 23 18:04:09.905524 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:09.905493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:04:12.587058 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:12.587003    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" podUID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" containerName="registry" containerID="cri-o://cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d" gracePeriod=30
Jul 23 18:04:12.646887 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:12.646862    2578 generic.go:356] "Generic (PLEG): container finished" podID="55fac291-a9fe-4603-b4b5-c8653547a376" containerID="a078e9b1429b4bcfba738fdef208b5f8d215a20bc21e406e411c5d06b1e58a71" exitCode=0
Jul 23 18:04:12.646994 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:12.646941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll" event={"ID":"55fac291-a9fe-4603-b4b5-c8653547a376","Type":"ContainerDied","Data":"a078e9b1429b4bcfba738fdef208b5f8d215a20bc21e406e411c5d06b1e58a71"}
Jul 23 18:04:12.647258 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:12.647242    2578 scope.go:117] "RemoveContainer" containerID="a078e9b1429b4bcfba738fdef208b5f8d215a20bc21e406e411c5d06b1e58a71"
Jul 23 18:04:12.908874 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:12.908851    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:04:13.037185 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037163    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-image-registry-private-configuration\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7bb764f9-da0d-4905-80e6-276f7ac7ab39-ca-trust-extracted\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-certificates\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-bound-sa-token\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037318    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnbr5\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-kube-api-access-rnbr5\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037622 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-installation-pull-secrets\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.037774 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:13.038274 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.037923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-trusted-ca\") pod \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\" (UID: \"7bb764f9-da0d-4905-80e6-276f7ac7ab39\") "
Jul 23 18:04:13.038274 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.038226    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-certificates\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.038274 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.038235    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:13.039832 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.039799    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:13.040190 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.040132    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:04:13.040190 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.040180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:13.040349 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.040330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:04:13.040395 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.040331    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-kube-api-access-rnbr5" (OuterVolumeSpecName: "kube-api-access-rnbr5") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "kube-api-access-rnbr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:13.045736 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.045714    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb764f9-da0d-4905-80e6-276f7ac7ab39-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7bb764f9-da0d-4905-80e6-276f7ac7ab39" (UID: "7bb764f9-da0d-4905-80e6-276f7ac7ab39"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139069    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-registry-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139094    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-image-registry-private-configuration\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139105    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7bb764f9-da0d-4905-80e6-276f7ac7ab39-ca-trust-extracted\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139113    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-bound-sa-token\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139123    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnbr5\" (UniqueName: \"kubernetes.io/projected/7bb764f9-da0d-4905-80e6-276f7ac7ab39-kube-api-access-rnbr5\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139131    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7bb764f9-da0d-4905-80e6-276f7ac7ab39-installation-pull-secrets\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.139139 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.139139    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7bb764f9-da0d-4905-80e6-276f7ac7ab39-trusted-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:13.652154 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.652123    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" containerID="cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d" exitCode=0
Jul 23 18:04:13.652690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.652165    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h"
Jul 23 18:04:13.652690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.652206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" event={"ID":"7bb764f9-da0d-4905-80e6-276f7ac7ab39","Type":"ContainerDied","Data":"cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d"}
Jul 23 18:04:13.652690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.652246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb44f59f5-r5m9h" event={"ID":"7bb764f9-da0d-4905-80e6-276f7ac7ab39","Type":"ContainerDied","Data":"4114799cf069537af50988b6259fda70d44bb1512cc953af17279733d2519c58"}
Jul 23 18:04:13.652690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.652264    2578 scope.go:117] "RemoveContainer" containerID="cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d"
Jul 23 18:04:13.654235 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.654213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-nqvll" event={"ID":"55fac291-a9fe-4603-b4b5-c8653547a376","Type":"ContainerStarted","Data":"559ff574837357309d9356c2061f4960e2ec75d57b98009f9f80116e1308f68a"}
Jul 23 18:04:13.661297 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.661283    2578 scope.go:117] "RemoveContainer" containerID="cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d"
Jul 23 18:04:13.661549 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:04:13.661529    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d\": container with ID starting with cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d not found: ID does not exist" containerID="cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d"
Jul 23 18:04:13.661631 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.661556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d"} err="failed to get container status \"cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d\": rpc error: code = NotFound desc = could not find container \"cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d\": container with ID starting with cc09976fef8e21f3c454e170e77b878506b7bbd4405ae12718500b23f512dc8d not found: ID does not exist"
Jul 23 18:04:13.689693 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.689669    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cb44f59f5-r5m9h"]
Jul 23 18:04:13.695559 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:13.695536    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cb44f59f5-r5m9h"]
Jul 23 18:04:14.120845 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:14.120817    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" path="/var/lib/kubelet/pods/7bb764f9-da0d-4905-80e6-276f7ac7ab39/volumes"
Jul 23 18:04:17.709530 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:17.709485    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f94ddbdf-7x42p" podUID="2f02f29e-e977-41d5-8d03-0562dcc1f86c" containerName="console" containerID="cri-o://25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7" gracePeriod=15
Jul 23 18:04:18.024603 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.024578    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:04:18.072750 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.072727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-config\") pod \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") "
Jul 23 18:04:18.072854 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.072761    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-oauth-serving-cert\") pod \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") "
Jul 23 18:04:18.072854 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.072785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-service-ca\") pod \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") "
Jul 23 18:04:18.072927 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.072860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcks9\" (UniqueName: \"kubernetes.io/projected/2f02f29e-e977-41d5-8d03-0562dcc1f86c-kube-api-access-bcks9\") pod \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") "
Jul 23 18:04:18.072927 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.072909    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-serving-cert\") pod \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") "
Jul 23 18:04:18.073007 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.072937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-oauth-config\") pod \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\" (UID: \"2f02f29e-e977-41d5-8d03-0562dcc1f86c\") "
Jul 23 18:04:18.073206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.073170    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-config" (OuterVolumeSpecName: "console-config") pod "2f02f29e-e977-41d5-8d03-0562dcc1f86c" (UID: "2f02f29e-e977-41d5-8d03-0562dcc1f86c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:18.073206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.073187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f02f29e-e977-41d5-8d03-0562dcc1f86c" (UID: "2f02f29e-e977-41d5-8d03-0562dcc1f86c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:18.073337 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.073239    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f02f29e-e977-41d5-8d03-0562dcc1f86c" (UID: "2f02f29e-e977-41d5-8d03-0562dcc1f86c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:18.075108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.075085    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f02f29e-e977-41d5-8d03-0562dcc1f86c" (UID: "2f02f29e-e977-41d5-8d03-0562dcc1f86c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:04:18.075197 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.075138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f02f29e-e977-41d5-8d03-0562dcc1f86c-kube-api-access-bcks9" (OuterVolumeSpecName: "kube-api-access-bcks9") pod "2f02f29e-e977-41d5-8d03-0562dcc1f86c" (UID: "2f02f29e-e977-41d5-8d03-0562dcc1f86c"). InnerVolumeSpecName "kube-api-access-bcks9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:18.075529 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.075511    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f02f29e-e977-41d5-8d03-0562dcc1f86c" (UID: "2f02f29e-e977-41d5-8d03-0562dcc1f86c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:04:18.102138 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.102114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:04:18.102256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.102209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:04:18.173815 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.173791    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-config\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:18.173815 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.173812    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-oauth-serving-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:18.173974 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.173827    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f02f29e-e977-41d5-8d03-0562dcc1f86c-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:18.173974 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.173840    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcks9\" (UniqueName: \"kubernetes.io/projected/2f02f29e-e977-41d5-8d03-0562dcc1f86c-kube-api-access-bcks9\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:18.173974 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.173853    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-serving-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:18.173974 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.173866    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f02f29e-e977-41d5-8d03-0562dcc1f86c-console-oauth-config\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:04:18.675051 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.675016    2578 generic.go:356] "Generic (PLEG): container finished" podID="2f02f29e-e977-41d5-8d03-0562dcc1f86c" containerID="25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7" exitCode=0
Jul 23 18:04:18.675206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.675070    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f94ddbdf-7x42p"
Jul 23 18:04:18.675206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.675093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f94ddbdf-7x42p" event={"ID":"2f02f29e-e977-41d5-8d03-0562dcc1f86c","Type":"ContainerDied","Data":"25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7"}
Jul 23 18:04:18.675206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.675137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f94ddbdf-7x42p" event={"ID":"2f02f29e-e977-41d5-8d03-0562dcc1f86c","Type":"ContainerDied","Data":"a5483a8187743e721618db0c0195e27a7a8dc2df8a3679fbbff2bb1f0633abd1"}
Jul 23 18:04:18.675206 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.675156    2578 scope.go:117] "RemoveContainer" containerID="25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7"
Jul 23 18:04:18.682985 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.682972    2578 scope.go:117] "RemoveContainer" containerID="25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7"
Jul 23 18:04:18.683219 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:04:18.683201    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7\": container with ID starting with 25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7 not found: ID does not exist" containerID="25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7"
Jul 23 18:04:18.683261 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.683238    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7"} err="failed to get container status \"25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7\": rpc error: code = NotFound desc = could not find container \"25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7\": container with ID starting with 25c16d52c34a3a71e13591c0bfef40d2bec0c5720ac048d0357ef3763dd829a7 not found: ID does not exist"
Jul 23 18:04:18.695158 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.695138    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f94ddbdf-7x42p"]
Jul 23 18:04:18.699974 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:18.699953    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f94ddbdf-7x42p"]
Jul 23 18:04:20.120696 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:20.120664    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f02f29e-e977-41d5-8d03-0562dcc1f86c" path="/var/lib/kubelet/pods/2f02f29e-e977-41d5-8d03-0562dcc1f86c/volumes"
Jul 23 18:04:22.691807 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:22.691775    2578 generic.go:356] "Generic (PLEG): container finished" podID="0ac2c07f-876c-4f8c-869b-29fd7f571275" containerID="a75cbc37cc109a9b4ececa6057dd18a59ef49cec241b44b7f04a6a69e7fcb39d" exitCode=0
Jul 23 18:04:22.692194 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:22.691847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2czr4" event={"ID":"0ac2c07f-876c-4f8c-869b-29fd7f571275","Type":"ContainerDied","Data":"a75cbc37cc109a9b4ececa6057dd18a59ef49cec241b44b7f04a6a69e7fcb39d"}
Jul 23 18:04:22.692194 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:22.692154    2578 scope.go:117] "RemoveContainer" containerID="a75cbc37cc109a9b4ececa6057dd18a59ef49cec241b44b7f04a6a69e7fcb39d"
Jul 23 18:04:23.697591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:23.697559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2czr4" event={"ID":"0ac2c07f-876c-4f8c-869b-29fd7f571275","Type":"ContainerStarted","Data":"4e570515d82e1906f99a608704cbd4a7d6f6636257d9c100d5223b22a9b8a7b7"}
Jul 23 18:04:31.727744 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:31.727661    2578 generic.go:356] "Generic (PLEG): container finished" podID="a05d7728-4f52-4836-a696-97e67e226a72" containerID="82c0fafba75b3ee2d5b7c4e2e1c2033413c733119df53d519771217a18ddb347" exitCode=0
Jul 23 18:04:31.728124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:31.727743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh" event={"ID":"a05d7728-4f52-4836-a696-97e67e226a72","Type":"ContainerDied","Data":"82c0fafba75b3ee2d5b7c4e2e1c2033413c733119df53d519771217a18ddb347"}
Jul 23 18:04:31.728124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:31.728068    2578 scope.go:117] "RemoveContainer" containerID="82c0fafba75b3ee2d5b7c4e2e1c2033413c733119df53d519771217a18ddb347"
Jul 23 18:04:32.732773 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:32.732735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-crlmh" event={"ID":"a05d7728-4f52-4836-a696-97e67e226a72","Type":"ContainerStarted","Data":"50d7c9180c35f68259a78ec90c28eedb9f487914c37a910f14f55a5331d8c49e"}
Jul 23 18:04:38.105460 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:38.105431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:04:38.109894 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:38.109873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86dd4ff6fd-krgrl"
Jul 23 18:04:59.905607 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:59.905565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:04:59.925176 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:04:59.925150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:05:00.854260 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:05:00.854234    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:07:18.003475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:18.003450    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 18:07:39.671125 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671088    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grwrd"]
Jul 23 18:07:39.671613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671396    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" containerName="registry"
Jul 23 18:07:39.671613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671422    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" containerName="registry"
Jul 23 18:07:39.671613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671444    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f02f29e-e977-41d5-8d03-0562dcc1f86c" containerName="console"
Jul 23 18:07:39.671613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671452    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f02f29e-e977-41d5-8d03-0562dcc1f86c" containerName="console"
Jul 23 18:07:39.671613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671520    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb764f9-da0d-4905-80e6-276f7ac7ab39" containerName="registry"
Jul 23 18:07:39.671613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.671527    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f02f29e-e977-41d5-8d03-0562dcc1f86c" containerName="console"
Jul 23 18:07:39.673300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.673284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.675939 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.675917    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 18:07:39.676036 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.675916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 18:07:39.676776 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.676761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kr2jk\""
Jul 23 18:07:39.688700 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.688679    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grwrd"]
Jul 23 18:07:39.727261 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.727235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/65c85b5d-abce-4927-8cd7-23d44a17de4b-kube-api-access-mpbcx\") pod \"cert-manager-55b4d954d5-grwrd\" (UID: \"65c85b5d-abce-4927-8cd7-23d44a17de4b\") " pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.727371 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.727285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65c85b5d-abce-4927-8cd7-23d44a17de4b-bound-sa-token\") pod \"cert-manager-55b4d954d5-grwrd\" (UID: \"65c85b5d-abce-4927-8cd7-23d44a17de4b\") " pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.828555 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.828532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/65c85b5d-abce-4927-8cd7-23d44a17de4b-kube-api-access-mpbcx\") pod \"cert-manager-55b4d954d5-grwrd\" (UID: \"65c85b5d-abce-4927-8cd7-23d44a17de4b\") " pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.828660 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.828576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65c85b5d-abce-4927-8cd7-23d44a17de4b-bound-sa-token\") pod \"cert-manager-55b4d954d5-grwrd\" (UID: \"65c85b5d-abce-4927-8cd7-23d44a17de4b\") " pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.842396 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.842365    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65c85b5d-abce-4927-8cd7-23d44a17de4b-bound-sa-token\") pod \"cert-manager-55b4d954d5-grwrd\" (UID: \"65c85b5d-abce-4927-8cd7-23d44a17de4b\") " pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.842494 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.842450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpbcx\" (UniqueName: \"kubernetes.io/projected/65c85b5d-abce-4927-8cd7-23d44a17de4b-kube-api-access-mpbcx\") pod \"cert-manager-55b4d954d5-grwrd\" (UID: \"65c85b5d-abce-4927-8cd7-23d44a17de4b\") " pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:39.991040 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:39.990971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-grwrd"
Jul 23 18:07:40.115199 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:40.115174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-grwrd"]
Jul 23 18:07:40.117990 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:07:40.117964    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c85b5d_abce_4927_8cd7_23d44a17de4b.slice/crio-61451fcd63c7bca61bf77b3fadfff1fe8ee51baa304039688836c1a876bfcca7 WatchSource:0}: Error finding container 61451fcd63c7bca61bf77b3fadfff1fe8ee51baa304039688836c1a876bfcca7: Status 404 returned error can't find the container with id 61451fcd63c7bca61bf77b3fadfff1fe8ee51baa304039688836c1a876bfcca7
Jul 23 18:07:40.120018 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:40.120002    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:07:40.424150 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:40.424116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grwrd" event={"ID":"65c85b5d-abce-4927-8cd7-23d44a17de4b","Type":"ContainerStarted","Data":"61451fcd63c7bca61bf77b3fadfff1fe8ee51baa304039688836c1a876bfcca7"}
Jul 23 18:07:43.441162 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:43.441130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-grwrd" event={"ID":"65c85b5d-abce-4927-8cd7-23d44a17de4b","Type":"ContainerStarted","Data":"45f7676f7279f336fbe1f1a95eb62a8f984093865ed179c7d0eecf7955931181"}
Jul 23 18:07:43.460107 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:07:43.460056    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-grwrd" podStartSLOduration=1.561876861 podStartE2EDuration="4.46004077s" totalImagesPullingTime="2.898163909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:43.459609527 +0000 UTC m=+325.872312316" watchObservedRunningTime="2026-07-23 18:07:43.46004077 +0000 UTC m=+325.872743557"
Jul 23 18:08:09.972721 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.972689    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"]
Jul 23 18:08:09.974822 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.974807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:09.978747 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.978722    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:08:09.978872 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.978803    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 18:08:09.979912 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.979893    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 18:08:09.980009 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.979922    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 18:08:09.980009 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.979930    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pjf62\""
Jul 23 18:08:09.980009 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.979894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 18:08:09.988120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:09.988099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"]
Jul 23 18:08:10.069541 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.069513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fgz\" (UniqueName: \"kubernetes.io/projected/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-kube-api-access-n6fgz\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.069640 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.069543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-manager-config\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.069640 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.069562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-cert\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.069709 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.069655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-metrics-cert\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.170218 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.170191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-metrics-cert\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.170378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.170226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fgz\" (UniqueName: \"kubernetes.io/projected/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-kube-api-access-n6fgz\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.170378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.170250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-manager-config\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.170378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.170359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-cert\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.170889 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.170867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-manager-config\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.172708 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.172680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-metrics-cert\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.172795 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.172732    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-cert\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.179358 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.179339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fgz\" (UniqueName: \"kubernetes.io/projected/a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5-kube-api-access-n6fgz\") pod \"lws-controller-manager-689d89c9b7-m8tsx\" (UID: \"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.283728 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.283710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:10.424688 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.424638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"]
Jul 23 18:08:10.427084 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:08:10.427051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e1929f_75a9_4f65_8e8e_c6b824b7e3c5.slice/crio-d38a7a8f8f079b3ea73e8fa0474deb2985d4ef4de2d8ecc93a7f75dec69b4c8f WatchSource:0}: Error finding container d38a7a8f8f079b3ea73e8fa0474deb2985d4ef4de2d8ecc93a7f75dec69b4c8f: Status 404 returned error can't find the container with id d38a7a8f8f079b3ea73e8fa0474deb2985d4ef4de2d8ecc93a7f75dec69b4c8f
Jul 23 18:08:10.541375 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:10.541320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx" event={"ID":"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5","Type":"ContainerStarted","Data":"d38a7a8f8f079b3ea73e8fa0474deb2985d4ef4de2d8ecc93a7f75dec69b4c8f"}
Jul 23 18:08:12.551646 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:12.551613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx" event={"ID":"a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5","Type":"ContainerStarted","Data":"a50307fffae2186ddfd90d93fc62eefe80e585ad04a90b7db393584caf600065"}
Jul 23 18:08:12.551971 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:12.551730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:12.584754 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:12.584711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx" podStartSLOduration=1.588236741 podStartE2EDuration="3.584697234s" totalImagesPullingTime="1.996460493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:12.58348997 +0000 UTC m=+354.996192758" watchObservedRunningTime="2026-07-23 18:08:12.584697234 +0000 UTC m=+354.997400022"
Jul 23 18:08:14.051915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.051882    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"]
Jul 23 18:08:14.054309 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.054291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.057292 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.057271    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 18:08:14.057463 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.057308    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 18:08:14.057463 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.057331    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 18:08:14.057463 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.057379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kfsfm\""
Jul 23 18:08:14.057624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.057583    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 18:08:14.068695 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.068675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"]
Jul 23 18:08:14.206158 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.206131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b08812e9-bc01-4569-8163-c8beb581342a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.206287 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.206166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747xj\" (UniqueName: \"kubernetes.io/projected/b08812e9-bc01-4569-8163-c8beb581342a-kube-api-access-747xj\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.206287 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.206197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b08812e9-bc01-4569-8163-c8beb581342a-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.206489 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.206303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b08812e9-bc01-4569-8163-c8beb581342a-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.206489 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.206341    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b08812e9-bc01-4569-8163-c8beb581342a-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.307438 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.307355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b08812e9-bc01-4569-8163-c8beb581342a-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.307557 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.307441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b08812e9-bc01-4569-8163-c8beb581342a-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.307557 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.307464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b08812e9-bc01-4569-8163-c8beb581342a-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.307557 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.307487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b08812e9-bc01-4569-8163-c8beb581342a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.307717 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.307627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747xj\" (UniqueName: \"kubernetes.io/projected/b08812e9-bc01-4569-8163-c8beb581342a-kube-api-access-747xj\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.307878 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.307842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b08812e9-bc01-4569-8163-c8beb581342a-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.309717 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.309695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b08812e9-bc01-4569-8163-c8beb581342a-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.309809 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.309782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b08812e9-bc01-4569-8163-c8beb581342a-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.309901 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.309884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b08812e9-bc01-4569-8163-c8beb581342a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.316308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.316285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747xj\" (UniqueName: \"kubernetes.io/projected/b08812e9-bc01-4569-8163-c8beb581342a-kube-api-access-747xj\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-vr265\" (UID: \"b08812e9-bc01-4569-8163-c8beb581342a\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.364279 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.364257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:14.500311 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.500284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"]
Jul 23 18:08:14.501711 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:08:14.501682    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08812e9_bc01_4569_8163_c8beb581342a.slice/crio-3df350e2fed58b08cd542466d6542b8674fd02454b8167993a128585faa59034 WatchSource:0}: Error finding container 3df350e2fed58b08cd542466d6542b8674fd02454b8167993a128585faa59034: Status 404 returned error can't find the container with id 3df350e2fed58b08cd542466d6542b8674fd02454b8167993a128585faa59034
Jul 23 18:08:14.561356 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:14.561290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265" event={"ID":"b08812e9-bc01-4569-8163-c8beb581342a","Type":"ContainerStarted","Data":"3df350e2fed58b08cd542466d6542b8674fd02454b8167993a128585faa59034"}
Jul 23 18:08:18.583745 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:18.583705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265" event={"ID":"b08812e9-bc01-4569-8163-c8beb581342a","Type":"ContainerStarted","Data":"403c44c606acc0cbd5bb261fb7760edb070e524c3ca623d174082de35657cf9b"}
Jul 23 18:08:19.589080 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:19.589044    2578 generic.go:356] "Generic (PLEG): container finished" podID="b08812e9-bc01-4569-8163-c8beb581342a" containerID="403c44c606acc0cbd5bb261fb7760edb070e524c3ca623d174082de35657cf9b" exitCode=0
Jul 23 18:08:19.589464 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:19.589126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265" event={"ID":"b08812e9-bc01-4569-8163-c8beb581342a","Type":"ContainerDied","Data":"403c44c606acc0cbd5bb261fb7760edb070e524c3ca623d174082de35657cf9b"}
Jul 23 18:08:20.595297 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:20.595255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265" event={"ID":"b08812e9-bc01-4569-8163-c8beb581342a","Type":"ContainerStarted","Data":"cf1daaf8f3a68c90b1086c36a3189414504e431289b10c3091ea5210fe99e3da"}
Jul 23 18:08:20.595679 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:20.595360    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:20.623733 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:20.623685    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265" podStartSLOduration=2.055864745 podStartE2EDuration="6.623670694s" totalImagesPullingTime="3.565296491s" totalInitContainerRuntime="1.002509458s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:20.621505797 +0000 UTC m=+363.034208641" watchObservedRunningTime="2026-07-23 18:08:20.623670694 +0000 UTC m=+363.036373481"
Jul 23 18:08:23.558129 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:23.558099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-m8tsx"
Jul 23 18:08:31.601584 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:31.601550    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-vr265"
Jul 23 18:08:37.514958 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.514929    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"]
Jul 23 18:08:37.523184 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.523165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.527017 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.526993    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 18:08:37.527184 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.527006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 18:08:37.527276 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.527055    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 18:08:37.527276 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.527047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n4vrt\""
Jul 23 18:08:37.527381 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.527055    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 18:08:37.531676 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.531654    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"]
Jul 23 18:08:37.598597 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.598567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpl2\" (UniqueName: \"kubernetes.io/projected/6777b2a5-f620-4f58-957a-be85058b40ea-kube-api-access-wjpl2\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.598740 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.598600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6777b2a5-f620-4f58-957a-be85058b40ea-tmp\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.598740 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.598622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6777b2a5-f620-4f58-957a-be85058b40ea-tls-certs\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.699717 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.699687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpl2\" (UniqueName: \"kubernetes.io/projected/6777b2a5-f620-4f58-957a-be85058b40ea-kube-api-access-wjpl2\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.699866 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.699726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6777b2a5-f620-4f58-957a-be85058b40ea-tmp\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.699866 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.699759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6777b2a5-f620-4f58-957a-be85058b40ea-tls-certs\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.701896 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.701879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6777b2a5-f620-4f58-957a-be85058b40ea-tmp\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.702190 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.702171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6777b2a5-f620-4f58-957a-be85058b40ea-tls-certs\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.714250 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.714225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpl2\" (UniqueName: \"kubernetes.io/projected/6777b2a5-f620-4f58-957a-be85058b40ea-kube-api-access-wjpl2\") pod \"kube-auth-proxy-84ccbf468f-2zqjq\" (UID: \"6777b2a5-f620-4f58-957a-be85058b40ea\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.834073 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.834047    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"
Jul 23 18:08:37.970717 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:37.970694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq"]
Jul 23 18:08:37.972582 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:08:37.972552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6777b2a5_f620_4f58_957a_be85058b40ea.slice/crio-57250dfb092b3b5bf28cc68e7eebb1beae74ab395a8d03749395eddc39061202 WatchSource:0}: Error finding container 57250dfb092b3b5bf28cc68e7eebb1beae74ab395a8d03749395eddc39061202: Status 404 returned error can't find the container with id 57250dfb092b3b5bf28cc68e7eebb1beae74ab395a8d03749395eddc39061202
Jul 23 18:08:38.672782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:38.672738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq" event={"ID":"6777b2a5-f620-4f58-957a-be85058b40ea","Type":"ContainerStarted","Data":"57250dfb092b3b5bf28cc68e7eebb1beae74ab395a8d03749395eddc39061202"}
Jul 23 18:08:41.686740 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:41.686705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq" event={"ID":"6777b2a5-f620-4f58-957a-be85058b40ea","Type":"ContainerStarted","Data":"5091ebfeca4594d522e119f1f78f54d442da9f5a0c76e74ffeddb3b7dd1b78cb"}
Jul 23 18:08:41.714577 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:08:41.714531    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-2zqjq" podStartSLOduration=2.029710849 podStartE2EDuration="4.714516437s" totalImagesPullingTime="2.684805588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:41.713565042 +0000 UTC m=+384.126267830" watchObservedRunningTime="2026-07-23 18:08:41.714516437 +0000 UTC m=+384.127219224"
Jul 23 18:10:18.560595 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.560554    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"]
Jul 23 18:10:18.562793 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.562772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:18.565715 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.565696    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 18:10:18.565893 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.565879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-md8p8\""
Jul 23 18:10:18.566958 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.566936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 18:10:18.567042 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.566949    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 18:10:18.580145 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.580111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"]
Jul 23 18:10:18.644153 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.644126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dr2w\" (UniqueName: \"kubernetes.io/projected/c1cd6875-496b-4127-a215-eb08e41d643c-kube-api-access-9dr2w\") pod \"dns-operator-controller-manager-864dd78c4c-ww6l5\" (UID: \"c1cd6875-496b-4127-a215-eb08e41d643c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:18.745234 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.745211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dr2w\" (UniqueName: \"kubernetes.io/projected/c1cd6875-496b-4127-a215-eb08e41d643c-kube-api-access-9dr2w\") pod \"dns-operator-controller-manager-864dd78c4c-ww6l5\" (UID: \"c1cd6875-496b-4127-a215-eb08e41d643c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:18.756987 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.756965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dr2w\" (UniqueName: \"kubernetes.io/projected/c1cd6875-496b-4127-a215-eb08e41d643c-kube-api-access-9dr2w\") pod \"dns-operator-controller-manager-864dd78c4c-ww6l5\" (UID: \"c1cd6875-496b-4127-a215-eb08e41d643c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:18.872690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.872631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:18.997958 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:18.997935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"]
Jul 23 18:10:19.000275 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:10:19.000247    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cd6875_496b_4127_a215_eb08e41d643c.slice/crio-e704165a806e0f67e4873e3d4fbfa2418cd76e8dbb1dca8a78b20c18fb1c76ed WatchSource:0}: Error finding container e704165a806e0f67e4873e3d4fbfa2418cd76e8dbb1dca8a78b20c18fb1c76ed: Status 404 returned error can't find the container with id e704165a806e0f67e4873e3d4fbfa2418cd76e8dbb1dca8a78b20c18fb1c76ed
Jul 23 18:10:19.093997 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:19.093963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5" event={"ID":"c1cd6875-496b-4127-a215-eb08e41d643c","Type":"ContainerStarted","Data":"e704165a806e0f67e4873e3d4fbfa2418cd76e8dbb1dca8a78b20c18fb1c76ed"}
Jul 23 18:10:21.105909 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.105877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5" event={"ID":"c1cd6875-496b-4127-a215-eb08e41d643c","Type":"ContainerStarted","Data":"86de23dead507419fe5e8ba1d8f50a1ca134b40c28bf94b21a94005baf17e563"}
Jul 23 18:10:21.106231 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.106004    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:21.114314 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.114288    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55958d7bc9-47d5q"]
Jul 23 18:10:21.117502 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.117486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.128216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.121555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 18:10:21.128216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.121747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 18:10:21.128216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.121805    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 18:10:21.128216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.121557    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 18:10:21.128216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.123389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-djpzv\""
Jul 23 18:10:21.128216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.124020    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 18:10:21.131429 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.131396    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 18:10:21.140246 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.140200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5" podStartSLOduration=1.193008477 podStartE2EDuration="3.140183699s" totalImagesPullingTime="1.947175222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:21.138570536 +0000 UTC m=+483.551273325" watchObservedRunningTime="2026-07-23 18:10:21.140183699 +0000 UTC m=+483.552886487"
Jul 23 18:10:21.150061 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.150042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55958d7bc9-47d5q"]
Jul 23 18:10:21.265851 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.265781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-serving-cert\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.265851 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.265813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-config\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.265851 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.265847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-trusted-ca-bundle\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.266045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.265920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-oauth-config\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.266045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.265951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-oauth-serving-cert\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.266045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.265976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8mj\" (UniqueName: \"kubernetes.io/projected/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-kube-api-access-zm8mj\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.266045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.266003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-service-ca\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367326 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-service-ca\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367461 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-serving-cert\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367461 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-config\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367461 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-trusted-ca-bundle\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367614 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-oauth-config\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367614 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-oauth-serving-cert\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.367614 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.367544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8mj\" (UniqueName: \"kubernetes.io/projected/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-kube-api-access-zm8mj\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.368151 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.368123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-service-ca\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.368249 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.368146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-config\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.368249 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.368191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-oauth-serving-cert\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.368358 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.368297    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-trusted-ca-bundle\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.369996 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.369972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-oauth-config\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.369996 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.369993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-console-serving-cert\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.377484 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.377462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8mj\" (UniqueName: \"kubernetes.io/projected/7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9-kube-api-access-zm8mj\") pod \"console-55958d7bc9-47d5q\" (UID: \"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9\") " pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.430535 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.430516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:21.556508 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:21.556485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55958d7bc9-47d5q"]
Jul 23 18:10:21.558536 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:10:21.558507    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2f43e4_b4d2_4087_921a_55e2ccbf7bf9.slice/crio-806ebc2a0e2ee82cfca0828c6315df0dfa627cffe14df112f2b79c10712e746d WatchSource:0}: Error finding container 806ebc2a0e2ee82cfca0828c6315df0dfa627cffe14df112f2b79c10712e746d: Status 404 returned error can't find the container with id 806ebc2a0e2ee82cfca0828c6315df0dfa627cffe14df112f2b79c10712e746d
Jul 23 18:10:22.112175 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:22.112136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55958d7bc9-47d5q" event={"ID":"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9","Type":"ContainerStarted","Data":"bdf44ffe2c2f1b65c466c8c97d55b068ee7da52d9bc02227dace631d33fb7ffd"}
Jul 23 18:10:22.112532 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:22.112195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55958d7bc9-47d5q" event={"ID":"7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9","Type":"ContainerStarted","Data":"806ebc2a0e2ee82cfca0828c6315df0dfa627cffe14df112f2b79c10712e746d"}
Jul 23 18:10:22.177267 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:22.177199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55958d7bc9-47d5q" podStartSLOduration=1.177178134 podStartE2EDuration="1.177178134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:22.17715673 +0000 UTC m=+484.589859518" watchObservedRunningTime="2026-07-23 18:10:22.177178134 +0000 UTC m=+484.589880926"
Jul 23 18:10:31.431199 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:31.431163    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:31.431700 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:31.431225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:31.435837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:31.435818    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:32.114867 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.114840    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ww6l5"
Jul 23 18:10:32.163931 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.163900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55958d7bc9-47d5q"
Jul 23 18:10:32.701169 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.701136    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"]
Jul 23 18:10:32.704830 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.704806    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:10:32.709366 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.709346    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bpwpb\""
Jul 23 18:10:32.715021 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.714997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"]
Jul 23 18:10:32.861806 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.861772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghbl\" (UniqueName: \"kubernetes.io/projected/8d207e04-19af-4fdb-901b-7567061a93f5-kube-api-access-rghbl\") pod \"limitador-operator-controller-manager-859d7b78bd-lbl5z\" (UID: \"8d207e04-19af-4fdb-901b-7567061a93f5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:10:32.962483 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.962455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rghbl\" (UniqueName: \"kubernetes.io/projected/8d207e04-19af-4fdb-901b-7567061a93f5-kube-api-access-rghbl\") pod \"limitador-operator-controller-manager-859d7b78bd-lbl5z\" (UID: \"8d207e04-19af-4fdb-901b-7567061a93f5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:10:32.975412 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:32.975388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghbl\" (UniqueName: \"kubernetes.io/projected/8d207e04-19af-4fdb-901b-7567061a93f5-kube-api-access-rghbl\") pod \"limitador-operator-controller-manager-859d7b78bd-lbl5z\" (UID: \"8d207e04-19af-4fdb-901b-7567061a93f5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:10:33.018008 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:33.017986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:10:33.179609 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:33.179579    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"]
Jul 23 18:10:33.192015 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:10:33.191978    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d207e04_19af_4fdb_901b_7567061a93f5.slice/crio-877cb25ef3be79ed9eb6885067ba31f75f91965eea1c3299e3b7dcbc9b507811 WatchSource:0}: Error finding container 877cb25ef3be79ed9eb6885067ba31f75f91965eea1c3299e3b7dcbc9b507811: Status 404 returned error can't find the container with id 877cb25ef3be79ed9eb6885067ba31f75f91965eea1c3299e3b7dcbc9b507811
Jul 23 18:10:34.170669 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:34.170637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z" event={"ID":"8d207e04-19af-4fdb-901b-7567061a93f5","Type":"ContainerStarted","Data":"877cb25ef3be79ed9eb6885067ba31f75f91965eea1c3299e3b7dcbc9b507811"}
Jul 23 18:10:35.176815 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:35.176740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z" event={"ID":"8d207e04-19af-4fdb-901b-7567061a93f5","Type":"ContainerStarted","Data":"81509f8942b608096aef551fef32eb50750c58fe4be5c24020f8b51841189bd9"}
Jul 23 18:10:35.177149 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:35.176866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:10:35.199243 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:35.199200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z" podStartSLOduration=1.617145729 podStartE2EDuration="3.199185905s" totalImagesPullingTime="1.582040176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:35.19820548 +0000 UTC m=+497.610908263" watchObservedRunningTime="2026-07-23 18:10:35.199185905 +0000 UTC m=+497.611888692"
Jul 23 18:10:46.183188 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:10:46.183158    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbl5z"
Jul 23 18:11:28.981378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:28.981339    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-n5lz8"]
Jul 23 18:11:28.983769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:28.983748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:28.986791 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:28.986771    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-chhsj\""
Jul 23 18:11:28.993346 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:28.993327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n5lz8"]
Jul 23 18:11:29.091089 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.091058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbxk\" (UniqueName: \"kubernetes.io/projected/d46c561a-8cdb-4519-9c4d-77bc88806089-kube-api-access-hhbxk\") pod \"authorino-58cd955675-n5lz8\" (UID: \"d46c561a-8cdb-4519-9c4d-77bc88806089\") " pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:29.192264 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.192229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbxk\" (UniqueName: \"kubernetes.io/projected/d46c561a-8cdb-4519-9c4d-77bc88806089-kube-api-access-hhbxk\") pod \"authorino-58cd955675-n5lz8\" (UID: \"d46c561a-8cdb-4519-9c4d-77bc88806089\") " pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:29.223458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.223419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbxk\" (UniqueName: \"kubernetes.io/projected/d46c561a-8cdb-4519-9c4d-77bc88806089-kube-api-access-hhbxk\") pod \"authorino-58cd955675-n5lz8\" (UID: \"d46c561a-8cdb-4519-9c4d-77bc88806089\") " pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:29.292737 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.292715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:29.308043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.308017    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z4fs6"]
Jul 23 18:11:29.310697 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.310676    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:11:29.317825 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.317800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z4fs6"]
Jul 23 18:11:29.393986 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.393874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8hvq\" (UniqueName: \"kubernetes.io/projected/b0ec4ad6-53be-4838-8a14-24b3e07034d3-kube-api-access-m8hvq\") pod \"authorino-75d556bd77-z4fs6\" (UID: \"b0ec4ad6-53be-4838-8a14-24b3e07034d3\") " pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:11:29.422921 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.422839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n5lz8"]
Jul 23 18:11:29.425681 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:11:29.425655    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd46c561a_8cdb_4519_9c4d_77bc88806089.slice/crio-8310553125da998ef8ba134d95cc840b69103563c23f1e24d1f0b7f23a7f1278 WatchSource:0}: Error finding container 8310553125da998ef8ba134d95cc840b69103563c23f1e24d1f0b7f23a7f1278: Status 404 returned error can't find the container with id 8310553125da998ef8ba134d95cc840b69103563c23f1e24d1f0b7f23a7f1278
Jul 23 18:11:29.495126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.495103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8hvq\" (UniqueName: \"kubernetes.io/projected/b0ec4ad6-53be-4838-8a14-24b3e07034d3-kube-api-access-m8hvq\") pod \"authorino-75d556bd77-z4fs6\" (UID: \"b0ec4ad6-53be-4838-8a14-24b3e07034d3\") " pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:11:29.503878 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.503857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8hvq\" (UniqueName: \"kubernetes.io/projected/b0ec4ad6-53be-4838-8a14-24b3e07034d3-kube-api-access-m8hvq\") pod \"authorino-75d556bd77-z4fs6\" (UID: \"b0ec4ad6-53be-4838-8a14-24b3e07034d3\") " pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:11:29.625860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.625774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:11:29.750183 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:29.750146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z4fs6"]
Jul 23 18:11:29.752800 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:11:29.752771    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ec4ad6_53be_4838_8a14_24b3e07034d3.slice/crio-a5bf724c7c96107c6db4ae42b541b97adbf8bc9f37af71de65b6b4ea259bdeb3 WatchSource:0}: Error finding container a5bf724c7c96107c6db4ae42b541b97adbf8bc9f37af71de65b6b4ea259bdeb3: Status 404 returned error can't find the container with id a5bf724c7c96107c6db4ae42b541b97adbf8bc9f37af71de65b6b4ea259bdeb3
Jul 23 18:11:30.422883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:30.421056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z4fs6" event={"ID":"b0ec4ad6-53be-4838-8a14-24b3e07034d3","Type":"ContainerStarted","Data":"a5bf724c7c96107c6db4ae42b541b97adbf8bc9f37af71de65b6b4ea259bdeb3"}
Jul 23 18:11:30.422883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:30.422572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n5lz8" event={"ID":"d46c561a-8cdb-4519-9c4d-77bc88806089","Type":"ContainerStarted","Data":"8310553125da998ef8ba134d95cc840b69103563c23f1e24d1f0b7f23a7f1278"}
Jul 23 18:11:33.439340 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:33.439292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n5lz8" event={"ID":"d46c561a-8cdb-4519-9c4d-77bc88806089","Type":"ContainerStarted","Data":"b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32"}
Jul 23 18:11:33.440699 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:33.440679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z4fs6" event={"ID":"b0ec4ad6-53be-4838-8a14-24b3e07034d3","Type":"ContainerStarted","Data":"dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273"}
Jul 23 18:11:33.460333 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:33.460289    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-n5lz8" podStartSLOduration=1.974393361 podStartE2EDuration="5.460276068s" totalImagesPullingTime="3.485882707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:33.457831997 +0000 UTC m=+555.870534785" watchObservedRunningTime="2026-07-23 18:11:33.460276068 +0000 UTC m=+555.872978855"
Jul 23 18:11:33.482075 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:33.482024    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z4fs6" podStartSLOduration=1.3329241459999999 podStartE2EDuration="4.482005026s" totalImagesPullingTime="3.14908088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:33.479751849 +0000 UTC m=+555.892454639" watchObservedRunningTime="2026-07-23 18:11:33.482005026 +0000 UTC m=+555.894707815"
Jul 23 18:11:33.507844 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:33.507817    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n5lz8"]
Jul 23 18:11:35.449046 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:35.449000    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-n5lz8" podUID="d46c561a-8cdb-4519-9c4d-77bc88806089" containerName="authorino" containerID="cri-o://b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32" gracePeriod=30
Jul 23 18:11:35.695910 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:35.695888    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:35.852349 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:35.852319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhbxk\" (UniqueName: \"kubernetes.io/projected/d46c561a-8cdb-4519-9c4d-77bc88806089-kube-api-access-hhbxk\") pod \"d46c561a-8cdb-4519-9c4d-77bc88806089\" (UID: \"d46c561a-8cdb-4519-9c4d-77bc88806089\") "
Jul 23 18:11:35.854241 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:35.854208    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46c561a-8cdb-4519-9c4d-77bc88806089-kube-api-access-hhbxk" (OuterVolumeSpecName: "kube-api-access-hhbxk") pod "d46c561a-8cdb-4519-9c4d-77bc88806089" (UID: "d46c561a-8cdb-4519-9c4d-77bc88806089"). InnerVolumeSpecName "kube-api-access-hhbxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:11:35.953172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:35.953128    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhbxk\" (UniqueName: \"kubernetes.io/projected/d46c561a-8cdb-4519-9c4d-77bc88806089-kube-api-access-hhbxk\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:11:36.454561 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.454481    2578 generic.go:356] "Generic (PLEG): container finished" podID="d46c561a-8cdb-4519-9c4d-77bc88806089" containerID="b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32" exitCode=0
Jul 23 18:11:36.454561 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.454523    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n5lz8"
Jul 23 18:11:36.454561 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.454544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n5lz8" event={"ID":"d46c561a-8cdb-4519-9c4d-77bc88806089","Type":"ContainerDied","Data":"b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32"}
Jul 23 18:11:36.454992 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.454573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n5lz8" event={"ID":"d46c561a-8cdb-4519-9c4d-77bc88806089","Type":"ContainerDied","Data":"8310553125da998ef8ba134d95cc840b69103563c23f1e24d1f0b7f23a7f1278"}
Jul 23 18:11:36.454992 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.454591    2578 scope.go:117] "RemoveContainer" containerID="b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32"
Jul 23 18:11:36.462859 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.462841    2578 scope.go:117] "RemoveContainer" containerID="b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32"
Jul 23 18:11:36.463111 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:11:36.463092    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32\": container with ID starting with b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32 not found: ID does not exist" containerID="b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32"
Jul 23 18:11:36.463157 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.463120    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32"} err="failed to get container status \"b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32\": rpc error: code = NotFound desc = could not find container \"b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32\": container with ID starting with b4ffa4401dfebfd606d416e88448749796fef71d8cb1ab66f57bf9fcaa41dc32 not found: ID does not exist"
Jul 23 18:11:36.471880 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.471860    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n5lz8"]
Jul 23 18:11:36.474427 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:36.474398    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-n5lz8"]
Jul 23 18:11:38.120818 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:38.120790    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d46c561a-8cdb-4519-9c4d-77bc88806089" path="/var/lib/kubelet/pods/d46c561a-8cdb-4519-9c4d-77bc88806089/volumes"
Jul 23 18:11:59.007044 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.007009    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrxxs"]
Jul 23 18:11:59.007456 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.007352    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d46c561a-8cdb-4519-9c4d-77bc88806089" containerName="authorino"
Jul 23 18:11:59.007456 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.007364    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d46c561a-8cdb-4519-9c4d-77bc88806089" containerName="authorino"
Jul 23 18:11:59.007456 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.007443    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d46c561a-8cdb-4519-9c4d-77bc88806089" containerName="authorino"
Jul 23 18:11:59.009209 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.009192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:11:59.018157 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.018124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrxxs"]
Jul 23 18:11:59.037356 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.037334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcr26\" (UniqueName: \"kubernetes.io/projected/d1d0408e-bd94-4a29-b5ac-31a04e4f908a-kube-api-access-lcr26\") pod \"authorino-5d4b67c446-jrxxs\" (UID: \"d1d0408e-bd94-4a29-b5ac-31a04e4f908a\") " pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:11:59.137892 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.137865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcr26\" (UniqueName: \"kubernetes.io/projected/d1d0408e-bd94-4a29-b5ac-31a04e4f908a-kube-api-access-lcr26\") pod \"authorino-5d4b67c446-jrxxs\" (UID: \"d1d0408e-bd94-4a29-b5ac-31a04e4f908a\") " pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:11:59.147263 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.147241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcr26\" (UniqueName: \"kubernetes.io/projected/d1d0408e-bd94-4a29-b5ac-31a04e4f908a-kube-api-access-lcr26\") pod \"authorino-5d4b67c446-jrxxs\" (UID: \"d1d0408e-bd94-4a29-b5ac-31a04e4f908a\") " pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:11:59.266858 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.266787    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrxxs"]
Jul 23 18:11:59.267030 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.267015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:11:59.297015 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.296989    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77df7ccb8d-cfh7l"]
Jul 23 18:11:59.299276 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.299260    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:11:59.309536 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.309511    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77df7ccb8d-cfh7l"]
Jul 23 18:11:59.339306 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.339274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xt5c\" (UniqueName: \"kubernetes.io/projected/7b334cf1-6766-489a-95ff-6d4a83ee1093-kube-api-access-4xt5c\") pod \"authorino-77df7ccb8d-cfh7l\" (UID: \"7b334cf1-6766-489a-95ff-6d4a83ee1093\") " pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:11:59.396058 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.396030    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrxxs"]
Jul 23 18:11:59.398905 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:11:59.398872    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1d0408e_bd94_4a29_b5ac_31a04e4f908a.slice/crio-50fa81202e3f3b2fa229d97e3da43f241f5d09dde9052884400c73122faf1a01 WatchSource:0}: Error finding container 50fa81202e3f3b2fa229d97e3da43f241f5d09dde9052884400c73122faf1a01: Status 404 returned error can't find the container with id 50fa81202e3f3b2fa229d97e3da43f241f5d09dde9052884400c73122faf1a01
Jul 23 18:11:59.440164 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.440137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xt5c\" (UniqueName: \"kubernetes.io/projected/7b334cf1-6766-489a-95ff-6d4a83ee1093-kube-api-access-4xt5c\") pod \"authorino-77df7ccb8d-cfh7l\" (UID: \"7b334cf1-6766-489a-95ff-6d4a83ee1093\") " pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:11:59.449805 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.449778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xt5c\" (UniqueName: \"kubernetes.io/projected/7b334cf1-6766-489a-95ff-6d4a83ee1093-kube-api-access-4xt5c\") pod \"authorino-77df7ccb8d-cfh7l\" (UID: \"7b334cf1-6766-489a-95ff-6d4a83ee1093\") " pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:11:59.556689 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.556664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrxxs" event={"ID":"d1d0408e-bd94-4a29-b5ac-31a04e4f908a","Type":"ContainerStarted","Data":"50fa81202e3f3b2fa229d97e3da43f241f5d09dde9052884400c73122faf1a01"}
Jul 23 18:11:59.571630 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.571605    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77df7ccb8d-cfh7l"]
Jul 23 18:11:59.571822 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.571812    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:11:59.605025 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.605000    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f6858b8d-qckgh"]
Jul 23 18:11:59.607449 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.607431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.610080 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.610063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 18:11:59.618296 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.618241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6858b8d-qckgh"]
Jul 23 18:11:59.641837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.641813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfk6k\" (UniqueName: \"kubernetes.io/projected/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-kube-api-access-jfk6k\") pod \"authorino-5f6858b8d-qckgh\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") " pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.641946 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.641849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-tls-cert\") pod \"authorino-5f6858b8d-qckgh\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") " pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.703567 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.703538    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77df7ccb8d-cfh7l"]
Jul 23 18:11:59.704096 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:11:59.704074    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b334cf1_6766_489a_95ff_6d4a83ee1093.slice/crio-8c64c90e360a596c6efc98f4db1b4d59c92d8b2791b1c5696863e9d6e65d7acd WatchSource:0}: Error finding container 8c64c90e360a596c6efc98f4db1b4d59c92d8b2791b1c5696863e9d6e65d7acd: Status 404 returned error can't find the container with id 8c64c90e360a596c6efc98f4db1b4d59c92d8b2791b1c5696863e9d6e65d7acd
Jul 23 18:11:59.742591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.742569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfk6k\" (UniqueName: \"kubernetes.io/projected/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-kube-api-access-jfk6k\") pod \"authorino-5f6858b8d-qckgh\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") " pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.742684 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.742606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-tls-cert\") pod \"authorino-5f6858b8d-qckgh\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") " pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.744814 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.744795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-tls-cert\") pod \"authorino-5f6858b8d-qckgh\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") " pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.756240 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.756221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfk6k\" (UniqueName: \"kubernetes.io/projected/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-kube-api-access-jfk6k\") pod \"authorino-5f6858b8d-qckgh\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") " pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:11:59.918198 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:11:59.918177    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:12:00.060488 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.060466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6858b8d-qckgh"]
Jul 23 18:12:00.065481 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:12:00.065456    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfad5f616_70c6_49d5_b6da_4f2f3c8c72aa.slice/crio-ad016c62e1d2edc96f125e552141cfd77cc89ebdce4262889564a6894da51e1a WatchSource:0}: Error finding container ad016c62e1d2edc96f125e552141cfd77cc89ebdce4262889564a6894da51e1a: Status 404 returned error can't find the container with id ad016c62e1d2edc96f125e552141cfd77cc89ebdce4262889564a6894da51e1a
Jul 23 18:12:00.562973 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.562942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6858b8d-qckgh" event={"ID":"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa","Type":"ContainerStarted","Data":"ad016c62e1d2edc96f125e552141cfd77cc89ebdce4262889564a6894da51e1a"}
Jul 23 18:12:00.564602 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.564560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l" event={"ID":"7b334cf1-6766-489a-95ff-6d4a83ee1093","Type":"ContainerStarted","Data":"57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950"}
Jul 23 18:12:00.564746 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.564608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l" event={"ID":"7b334cf1-6766-489a-95ff-6d4a83ee1093","Type":"ContainerStarted","Data":"8c64c90e360a596c6efc98f4db1b4d59c92d8b2791b1c5696863e9d6e65d7acd"}
Jul 23 18:12:00.564746 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.564595    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l" podUID="7b334cf1-6766-489a-95ff-6d4a83ee1093" containerName="authorino" containerID="cri-o://57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950" gracePeriod=30
Jul 23 18:12:00.566141 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.566116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrxxs" event={"ID":"d1d0408e-bd94-4a29-b5ac-31a04e4f908a","Type":"ContainerStarted","Data":"7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9"}
Jul 23 18:12:00.566269 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.566136    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-jrxxs" podUID="d1d0408e-bd94-4a29-b5ac-31a04e4f908a" containerName="authorino" containerID="cri-o://7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9" gracePeriod=30
Jul 23 18:12:00.580288 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.580249    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l" podStartSLOduration=1.256210057 podStartE2EDuration="1.58023504s" totalImagesPullingTime="324.024983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:00.579713272 +0000 UTC m=+582.992416061" watchObservedRunningTime="2026-07-23 18:12:00.58023504 +0000 UTC m=+582.992937828"
Jul 23 18:12:00.598963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.598927    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-jrxxs" podStartSLOduration=2.118528677 podStartE2EDuration="2.598912541s" totalImagesPullingTime="480.383864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:00.598009505 +0000 UTC m=+583.010712298" watchObservedRunningTime="2026-07-23 18:12:00.598912541 +0000 UTC m=+583.011615331"
Jul 23 18:12:00.805484 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.805454    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:12:00.838201 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.838177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:12:00.851935 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.851913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcr26\" (UniqueName: \"kubernetes.io/projected/d1d0408e-bd94-4a29-b5ac-31a04e4f908a-kube-api-access-lcr26\") pod \"d1d0408e-bd94-4a29-b5ac-31a04e4f908a\" (UID: \"d1d0408e-bd94-4a29-b5ac-31a04e4f908a\") "
Jul 23 18:12:00.852039 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.851970    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xt5c\" (UniqueName: \"kubernetes.io/projected/7b334cf1-6766-489a-95ff-6d4a83ee1093-kube-api-access-4xt5c\") pod \"7b334cf1-6766-489a-95ff-6d4a83ee1093\" (UID: \"7b334cf1-6766-489a-95ff-6d4a83ee1093\") "
Jul 23 18:12:00.853843 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.853815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d0408e-bd94-4a29-b5ac-31a04e4f908a-kube-api-access-lcr26" (OuterVolumeSpecName: "kube-api-access-lcr26") pod "d1d0408e-bd94-4a29-b5ac-31a04e4f908a" (UID: "d1d0408e-bd94-4a29-b5ac-31a04e4f908a"). InnerVolumeSpecName "kube-api-access-lcr26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:12:00.854093 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.854067    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b334cf1-6766-489a-95ff-6d4a83ee1093-kube-api-access-4xt5c" (OuterVolumeSpecName: "kube-api-access-4xt5c") pod "7b334cf1-6766-489a-95ff-6d4a83ee1093" (UID: "7b334cf1-6766-489a-95ff-6d4a83ee1093"). InnerVolumeSpecName "kube-api-access-4xt5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:12:00.953181 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.953147    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcr26\" (UniqueName: \"kubernetes.io/projected/d1d0408e-bd94-4a29-b5ac-31a04e4f908a-kube-api-access-lcr26\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:12:00.953181 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:00.953174    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xt5c\" (UniqueName: \"kubernetes.io/projected/7b334cf1-6766-489a-95ff-6d4a83ee1093-kube-api-access-4xt5c\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:12:01.572035 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.572000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6858b8d-qckgh" event={"ID":"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa","Type":"ContainerStarted","Data":"87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3"}
Jul 23 18:12:01.573251 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.573226    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b334cf1-6766-489a-95ff-6d4a83ee1093" containerID="57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950" exitCode=0
Jul 23 18:12:01.573340 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.573254    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l"
Jul 23 18:12:01.573340 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.573309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l" event={"ID":"7b334cf1-6766-489a-95ff-6d4a83ee1093","Type":"ContainerDied","Data":"57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950"}
Jul 23 18:12:01.573435 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.573345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77df7ccb8d-cfh7l" event={"ID":"7b334cf1-6766-489a-95ff-6d4a83ee1093","Type":"ContainerDied","Data":"8c64c90e360a596c6efc98f4db1b4d59c92d8b2791b1c5696863e9d6e65d7acd"}
Jul 23 18:12:01.573435 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.573369    2578 scope.go:117] "RemoveContainer" containerID="57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950"
Jul 23 18:12:01.574660 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.574429    2578 generic.go:356] "Generic (PLEG): container finished" podID="d1d0408e-bd94-4a29-b5ac-31a04e4f908a" containerID="7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9" exitCode=0
Jul 23 18:12:01.574660 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.574455    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrxxs"
Jul 23 18:12:01.574660 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.574463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrxxs" event={"ID":"d1d0408e-bd94-4a29-b5ac-31a04e4f908a","Type":"ContainerDied","Data":"7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9"}
Jul 23 18:12:01.574660 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.574488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrxxs" event={"ID":"d1d0408e-bd94-4a29-b5ac-31a04e4f908a","Type":"ContainerDied","Data":"50fa81202e3f3b2fa229d97e3da43f241f5d09dde9052884400c73122faf1a01"}
Jul 23 18:12:01.582310 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.582167    2578 scope.go:117] "RemoveContainer" containerID="57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950"
Jul 23 18:12:01.582510 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:12:01.582482    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950\": container with ID starting with 57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950 not found: ID does not exist" containerID="57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950"
Jul 23 18:12:01.582573 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.582522    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950"} err="failed to get container status \"57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950\": rpc error: code = NotFound desc = could not find container \"57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950\": container with ID starting with 57d6cb4760864f5447c1c7840b0bb68bea86e96ab89efa9856a76f8dedbbf950 not found: ID does not exist"
Jul 23 18:12:01.582573 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.582547    2578 scope.go:117] "RemoveContainer" containerID="7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9"
Jul 23 18:12:01.590616 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.590596    2578 scope.go:117] "RemoveContainer" containerID="7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9"
Jul 23 18:12:01.590878 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:12:01.590857    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9\": container with ID starting with 7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9 not found: ID does not exist" containerID="7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9"
Jul 23 18:12:01.590935 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.590885    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9"} err="failed to get container status \"7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9\": rpc error: code = NotFound desc = could not find container \"7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9\": container with ID starting with 7a5bd856fe0bfd23c581a4b5adc7142484f2923f1f0e1cdecc1e2041e3e188f9 not found: ID does not exist"
Jul 23 18:12:01.592136 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.592099    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f6858b8d-qckgh" podStartSLOduration=2.081595736 podStartE2EDuration="2.592087464s" totalImagesPullingTime="510.491728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:01.590083485 +0000 UTC m=+584.002786274" watchObservedRunningTime="2026-07-23 18:12:01.592087464 +0000 UTC m=+584.004790254"
Jul 23 18:12:01.607669 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.607645    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77df7ccb8d-cfh7l"]
Jul 23 18:12:01.609156 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.609133    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77df7ccb8d-cfh7l"]
Jul 23 18:12:01.618927 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.618903    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z4fs6"]
Jul 23 18:12:01.619063 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.619044    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z4fs6" podUID="b0ec4ad6-53be-4838-8a14-24b3e07034d3" containerName="authorino" containerID="cri-o://dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273" gracePeriod=30
Jul 23 18:12:01.628095 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.628075    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrxxs"]
Jul 23 18:12:01.633766 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.633742    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrxxs"]
Jul 23 18:12:01.869156 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.869131    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:12:01.962379 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.962349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8hvq\" (UniqueName: \"kubernetes.io/projected/b0ec4ad6-53be-4838-8a14-24b3e07034d3-kube-api-access-m8hvq\") pod \"b0ec4ad6-53be-4838-8a14-24b3e07034d3\" (UID: \"b0ec4ad6-53be-4838-8a14-24b3e07034d3\") "
Jul 23 18:12:01.964358 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:01.964335    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ec4ad6-53be-4838-8a14-24b3e07034d3-kube-api-access-m8hvq" (OuterVolumeSpecName: "kube-api-access-m8hvq") pod "b0ec4ad6-53be-4838-8a14-24b3e07034d3" (UID: "b0ec4ad6-53be-4838-8a14-24b3e07034d3"). InnerVolumeSpecName "kube-api-access-m8hvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:12:02.063707 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.063629    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8hvq\" (UniqueName: \"kubernetes.io/projected/b0ec4ad6-53be-4838-8a14-24b3e07034d3-kube-api-access-m8hvq\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:12:02.125424 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.125331    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b334cf1-6766-489a-95ff-6d4a83ee1093" path="/var/lib/kubelet/pods/7b334cf1-6766-489a-95ff-6d4a83ee1093/volumes"
Jul 23 18:12:02.125743 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.125728    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1d0408e-bd94-4a29-b5ac-31a04e4f908a" path="/var/lib/kubelet/pods/d1d0408e-bd94-4a29-b5ac-31a04e4f908a/volumes"
Jul 23 18:12:02.580221 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.580187    2578 generic.go:356] "Generic (PLEG): container finished" podID="b0ec4ad6-53be-4838-8a14-24b3e07034d3" containerID="dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273" exitCode=0
Jul 23 18:12:02.580221 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.580219    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z4fs6"
Jul 23 18:12:02.580714 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.580258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z4fs6" event={"ID":"b0ec4ad6-53be-4838-8a14-24b3e07034d3","Type":"ContainerDied","Data":"dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273"}
Jul 23 18:12:02.580714 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.580303    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z4fs6" event={"ID":"b0ec4ad6-53be-4838-8a14-24b3e07034d3","Type":"ContainerDied","Data":"a5bf724c7c96107c6db4ae42b541b97adbf8bc9f37af71de65b6b4ea259bdeb3"}
Jul 23 18:12:02.580714 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.580320    2578 scope.go:117] "RemoveContainer" containerID="dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273"
Jul 23 18:12:02.588562 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.588541    2578 scope.go:117] "RemoveContainer" containerID="dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273"
Jul 23 18:12:02.588816 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:12:02.588796    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273\": container with ID starting with dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273 not found: ID does not exist" containerID="dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273"
Jul 23 18:12:02.588869 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.588824    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273"} err="failed to get container status \"dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273\": rpc error: code = NotFound desc = could not find container \"dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273\": container with ID starting with dbb85c1c7f071958b34668d4480aa5f08bd467a5c753380c62b1dca0ff354273 not found: ID does not exist"
Jul 23 18:12:02.611232 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.611207    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z4fs6"]
Jul 23 18:12:02.617202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:02.617181    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z4fs6"]
Jul 23 18:12:04.121316 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:04.121284    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ec4ad6-53be-4838-8a14-24b3e07034d3" path="/var/lib/kubelet/pods/b0ec4ad6-53be-4838-8a14-24b3e07034d3/volumes"
Jul 23 18:12:06.922085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922050    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76f757f7f7-5982x"]
Jul 23 18:12:06.922591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922552    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d0408e-bd94-4a29-b5ac-31a04e4f908a" containerName="authorino"
Jul 23 18:12:06.922591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922572    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d0408e-bd94-4a29-b5ac-31a04e4f908a" containerName="authorino"
Jul 23 18:12:06.922591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922583    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b334cf1-6766-489a-95ff-6d4a83ee1093" containerName="authorino"
Jul 23 18:12:06.922591 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b334cf1-6766-489a-95ff-6d4a83ee1093" containerName="authorino"
Jul 23 18:12:06.922782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922637    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ec4ad6-53be-4838-8a14-24b3e07034d3" containerName="authorino"
Jul 23 18:12:06.922782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922647    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ec4ad6-53be-4838-8a14-24b3e07034d3" containerName="authorino"
Jul 23 18:12:06.922782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922729    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ec4ad6-53be-4838-8a14-24b3e07034d3" containerName="authorino"
Jul 23 18:12:06.922782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922744    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d0408e-bd94-4a29-b5ac-31a04e4f908a" containerName="authorino"
Jul 23 18:12:06.922782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.922754    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b334cf1-6766-489a-95ff-6d4a83ee1093" containerName="authorino"
Jul 23 18:12:06.927025 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.927004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:06.929576 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.929558    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:12:06.929655 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.929609    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-82546\""
Jul 23 18:12:06.929903 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.929887    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:12:06.935889 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:06.935869    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-5982x"]
Jul 23 18:12:07.008138 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.008117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29f62\" (UniqueName: \"kubernetes.io/projected/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-kube-api-access-29f62\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.008267 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.008171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.108811 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.108785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29f62\" (UniqueName: \"kubernetes.io/projected/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-kube-api-access-29f62\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.108908 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.108853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.108956 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:12:07.108936    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 18:12:07.109006 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:12:07.108997    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert podName:5f62ec1c-64c2-404b-be9b-ffb8f7175c51 nodeName:}" failed. No retries permitted until 2026-07-23 18:12:07.60898167 +0000 UTC m=+590.021684436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert") pod "maas-controller-76f757f7f7-5982x" (UID: "5f62ec1c-64c2-404b-be9b-ffb8f7175c51") : secret "maas-controller-webhook-cert" not found
Jul 23 18:12:07.118210 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.118191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29f62\" (UniqueName: \"kubernetes.io/projected/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-kube-api-access-29f62\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.612747 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.612715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.615014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.614987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert\") pod \"maas-controller-76f757f7f7-5982x\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") " pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.838878 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.838847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:07.967201 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:07.967170    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-5982x"]
Jul 23 18:12:07.970150 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:12:07.970118    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f62ec1c_64c2_404b_be9b_ffb8f7175c51.slice/crio-35fed50c488510e04ed70d562eefefedf52cd46ae6217fbc624250a87ea47253 WatchSource:0}: Error finding container 35fed50c488510e04ed70d562eefefedf52cd46ae6217fbc624250a87ea47253: Status 404 returned error can't find the container with id 35fed50c488510e04ed70d562eefefedf52cd46ae6217fbc624250a87ea47253
Jul 23 18:12:08.613536 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:08.613497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-5982x" event={"ID":"5f62ec1c-64c2-404b-be9b-ffb8f7175c51","Type":"ContainerStarted","Data":"35fed50c488510e04ed70d562eefefedf52cd46ae6217fbc624250a87ea47253"}
Jul 23 18:12:10.626852 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:10.626817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-5982x" event={"ID":"5f62ec1c-64c2-404b-be9b-ffb8f7175c51","Type":"ContainerStarted","Data":"e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43"}
Jul 23 18:12:10.627308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:10.626905    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:12:10.648459 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:10.648402    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76f757f7f7-5982x" podStartSLOduration=2.360949145 podStartE2EDuration="4.648389564s" totalImagesPullingTime="2.287440419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:10.646297432 +0000 UTC m=+593.059000220" watchObservedRunningTime="2026-07-23 18:12:10.648389564 +0000 UTC m=+593.061092489"
Jul 23 18:12:21.633740 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:12:21.633711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:13:04.286590 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.286508    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"]
Jul 23 18:13:04.293455 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.293437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.296198 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.296176    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 18:13:04.296300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.296248    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 18:13:04.297286 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.297269    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 18:13:04.297469 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.297363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8jklp\""
Jul 23 18:13:04.299752 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.299733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"]
Jul 23 18:13:04.359513 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.359485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.359647 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.359529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8nm\" (UniqueName: \"kubernetes.io/projected/599c3c05-c048-4012-9ca8-dc561915a497-kube-api-access-5q8nm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.359647 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.359561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.359647 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.359602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599c3c05-c048-4012-9ca8-dc561915a497-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.359647 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.359633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.359807 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.359720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.460969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.460940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.460984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599c3c05-c048-4012-9ca8-dc561915a497-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461283 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461283 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8nm\" (UniqueName: \"kubernetes.io/projected/599c3c05-c048-4012-9ca8-dc561915a497-kube-api-access-5q8nm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461453 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461681 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.461681 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.461675    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.463285 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.463259    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/599c3c05-c048-4012-9ca8-dc561915a497-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.463563 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.463546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599c3c05-c048-4012-9ca8-dc561915a497-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.469870 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.469850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8nm\" (UniqueName: \"kubernetes.io/projected/599c3c05-c048-4012-9ca8-dc561915a497-kube-api-access-5q8nm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z\" (UID: \"599c3c05-c048-4012-9ca8-dc561915a497\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.604873 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.604806    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:04.731023 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.730997    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"]
Jul 23 18:13:04.732896 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:13:04.732862    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599c3c05_c048_4012_9ca8_dc561915a497.slice/crio-3a6692f8215de24d8de2fc077155ce214a84eb3d3858a8586d3102daae533699 WatchSource:0}: Error finding container 3a6692f8215de24d8de2fc077155ce214a84eb3d3858a8586d3102daae533699: Status 404 returned error can't find the container with id 3a6692f8215de24d8de2fc077155ce214a84eb3d3858a8586d3102daae533699
Jul 23 18:13:04.734238 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.734221    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:13:04.876385 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:04.876302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z" event={"ID":"599c3c05-c048-4012-9ca8-dc561915a497","Type":"ContainerStarted","Data":"3a6692f8215de24d8de2fc077155ce214a84eb3d3858a8586d3102daae533699"}
Jul 23 18:13:06.886943 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:06.886913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z" event={"ID":"599c3c05-c048-4012-9ca8-dc561915a497","Type":"ContainerStarted","Data":"9c466052725524bf1958889bd9be5adeb093ef2d7554616236e9131df5c96ace"}
Jul 23 18:13:06.911019 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:06.910971    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z" podStartSLOduration=1.791682051 podStartE2EDuration="2.91095668s" totalImagesPullingTime="1.119274629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:13:06.909026545 +0000 UTC m=+649.321729358" watchObservedRunningTime="2026-07-23 18:13:06.91095668 +0000 UTC m=+649.323659469"
Jul 23 18:13:14.605742 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:14.605036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:14.606222 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:14.606159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:14.618448 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:14.618422    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:14.933724 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:14.933652    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z"
Jul 23 18:13:20.587043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.587000    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"]
Jul 23 18:13:20.590377 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.590357    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.593624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.593606    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 18:13:20.601824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.601798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"]
Jul 23 18:13:20.687837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.687816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.687937 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.687849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.687937 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.687869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.687937 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.687888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2932802-af14-43bb-bf44-54bb6513e200-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.688077 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.687968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.688077 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.687994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86c4\" (UniqueName: \"kubernetes.io/projected/f2932802-af14-43bb-bf44-54bb6513e200-kube-api-access-c86c4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.788621 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.788599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.788709 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.788634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.788709 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.788661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.788709 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.788691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2932802-af14-43bb-bf44-54bb6513e200-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.788840 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.788742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.788840 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.788766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86c4\" (UniqueName: \"kubernetes.io/projected/f2932802-af14-43bb-bf44-54bb6513e200-kube-api-access-c86c4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.789031 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.789000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.789099 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.789057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.789099 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.789079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.790763 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.790743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2932802-af14-43bb-bf44-54bb6513e200-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.791094 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.791074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2932802-af14-43bb-bf44-54bb6513e200-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.797357 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.797340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86c4\" (UniqueName: \"kubernetes.io/projected/f2932802-af14-43bb-bf44-54bb6513e200-kube-api-access-c86c4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xhbsz\" (UID: \"f2932802-af14-43bb-bf44-54bb6513e200\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:20.902900 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:20.902851    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:21.032080 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:21.032058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"]
Jul 23 18:13:21.035082 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:13:21.035051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2932802_af14_43bb_bf44_54bb6513e200.slice/crio-6bf4f9de862d2803d0de494c74aea057c075b05f1230cfbe1d4a43e4a1ef7f8a WatchSource:0}: Error finding container 6bf4f9de862d2803d0de494c74aea057c075b05f1230cfbe1d4a43e4a1ef7f8a: Status 404 returned error can't find the container with id 6bf4f9de862d2803d0de494c74aea057c075b05f1230cfbe1d4a43e4a1ef7f8a
Jul 23 18:13:21.957132 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:21.957096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz" event={"ID":"f2932802-af14-43bb-bf44-54bb6513e200","Type":"ContainerStarted","Data":"d3dd088b494555561b29c24b42787b34b7df49ae22db35c374f886c43debefc1"}
Jul 23 18:13:21.957548 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:21.957148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz" event={"ID":"f2932802-af14-43bb-bf44-54bb6513e200","Type":"ContainerStarted","Data":"6bf4f9de862d2803d0de494c74aea057c075b05f1230cfbe1d4a43e4a1ef7f8a"}
Jul 23 18:13:21.987613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:21.987562    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz" podStartSLOduration=1.7306729029999999 podStartE2EDuration="1.987545285s" totalImagesPullingTime="256.872382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:13:21.987288283 +0000 UTC m=+664.399991070" watchObservedRunningTime="2026-07-23 18:13:21.987545285 +0000 UTC m=+664.400248099"
Jul 23 18:13:30.903643 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:30.903613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:30.903983 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:30.903664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:30.915855 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:30.915827    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:31.009590 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:31.009564    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xhbsz"
Jul 23 18:13:33.696704 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.696673    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"]
Jul 23 18:13:33.701045 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.701022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.707116 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.707095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 18:13:33.720308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.720285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"]
Jul 23 18:13:33.804178 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.804147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb31e569-ea21-495e-a5bd-8937c77620fa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.804316 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.804191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.804316 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.804225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.804445 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.804327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zztzl\" (UniqueName: \"kubernetes.io/projected/cb31e569-ea21-495e-a5bd-8937c77620fa-kube-api-access-zztzl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.804445 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.804437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.804519 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.804458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905248 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905248 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905482 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zztzl\" (UniqueName: \"kubernetes.io/projected/cb31e569-ea21-495e-a5bd-8937c77620fa-kube-api-access-zztzl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905482 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905482 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905482 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb31e569-ea21-495e-a5bd-8937c77620fa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905731 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.905823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.905786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.907674 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.907654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb31e569-ea21-495e-a5bd-8937c77620fa-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.907935 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.907916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb31e569-ea21-495e-a5bd-8937c77620fa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:33.916215 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:33.916186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zztzl\" (UniqueName: \"kubernetes.io/projected/cb31e569-ea21-495e-a5bd-8937c77620fa-kube-api-access-zztzl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rb54c\" (UID: \"cb31e569-ea21-495e-a5bd-8937c77620fa\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:34.013076 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:34.013011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:34.157222 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:34.157197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"]
Jul 23 18:13:34.158876 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:13:34.158850    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb31e569_ea21_495e_a5bd_8937c77620fa.slice/crio-b19509e51adb8191ab59e89f46ac7dc5e831e5725155fb707c9ce6cb5a4b850b WatchSource:0}: Error finding container b19509e51adb8191ab59e89f46ac7dc5e831e5725155fb707c9ce6cb5a4b850b: Status 404 returned error can't find the container with id b19509e51adb8191ab59e89f46ac7dc5e831e5725155fb707c9ce6cb5a4b850b
Jul 23 18:13:35.018965 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:35.018938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c" event={"ID":"cb31e569-ea21-495e-a5bd-8937c77620fa","Type":"ContainerStarted","Data":"785559411ca56366356b9c09b671ce469cc894a5b945d547dfe498a355024d8a"}
Jul 23 18:13:35.019335 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:35.018984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c" event={"ID":"cb31e569-ea21-495e-a5bd-8937c77620fa","Type":"ContainerStarted","Data":"b19509e51adb8191ab59e89f46ac7dc5e831e5725155fb707c9ce6cb5a4b850b"}
Jul 23 18:13:35.047531 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:35.047485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c" podStartSLOduration=1.858205993 podStartE2EDuration="2.047471114s" totalImagesPullingTime="189.265121ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:13:35.045913266 +0000 UTC m=+677.458616055" watchObservedRunningTime="2026-07-23 18:13:35.047471114 +0000 UTC m=+677.460173903"
Jul 23 18:13:44.013645 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:44.013609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:44.014090 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:44.013668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:44.026058 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:44.026036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:13:44.071328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:13:44.071303    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rb54c"
Jul 23 18:15:15.902400 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:15.902368    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8ddd58c4f-bkq45"]
Jul 23 18:15:15.905690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:15.905673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:15.913424 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:15.913378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8ddd58c4f-bkq45"]
Jul 23 18:15:15.940869 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:15.940842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6gs9\" (UniqueName: \"kubernetes.io/projected/8c96b805-c16c-471b-997a-fb2a244b7728-kube-api-access-p6gs9\") pod \"authorino-8ddd58c4f-bkq45\" (UID: \"8c96b805-c16c-471b-997a-fb2a244b7728\") " pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:15.940966 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:15.940890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c96b805-c16c-471b-997a-fb2a244b7728-tls-cert\") pod \"authorino-8ddd58c4f-bkq45\" (UID: \"8c96b805-c16c-471b-997a-fb2a244b7728\") " pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:16.041450 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.041425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6gs9\" (UniqueName: \"kubernetes.io/projected/8c96b805-c16c-471b-997a-fb2a244b7728-kube-api-access-p6gs9\") pod \"authorino-8ddd58c4f-bkq45\" (UID: \"8c96b805-c16c-471b-997a-fb2a244b7728\") " pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:16.041544 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.041479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c96b805-c16c-471b-997a-fb2a244b7728-tls-cert\") pod \"authorino-8ddd58c4f-bkq45\" (UID: \"8c96b805-c16c-471b-997a-fb2a244b7728\") " pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:16.043919 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.043889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c96b805-c16c-471b-997a-fb2a244b7728-tls-cert\") pod \"authorino-8ddd58c4f-bkq45\" (UID: \"8c96b805-c16c-471b-997a-fb2a244b7728\") " pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:16.053312 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.053292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6gs9\" (UniqueName: \"kubernetes.io/projected/8c96b805-c16c-471b-997a-fb2a244b7728-kube-api-access-p6gs9\") pod \"authorino-8ddd58c4f-bkq45\" (UID: \"8c96b805-c16c-471b-997a-fb2a244b7728\") " pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:16.214535 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.214481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8ddd58c4f-bkq45"
Jul 23 18:15:16.345890 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.345863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8ddd58c4f-bkq45"]
Jul 23 18:15:16.348067 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:15:16.348012    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c96b805_c16c_471b_997a_fb2a244b7728.slice/crio-ad32437d38fead805754072e1551cd604089b94b7b204362c29640a5e6629aa9 WatchSource:0}: Error finding container ad32437d38fead805754072e1551cd604089b94b7b204362c29640a5e6629aa9: Status 404 returned error can't find the container with id ad32437d38fead805754072e1551cd604089b94b7b204362c29640a5e6629aa9
Jul 23 18:15:16.479166 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:16.479090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8ddd58c4f-bkq45" event={"ID":"8c96b805-c16c-471b-997a-fb2a244b7728","Type":"ContainerStarted","Data":"ad32437d38fead805754072e1551cd604089b94b7b204362c29640a5e6629aa9"}
Jul 23 18:15:17.487114 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.487067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8ddd58c4f-bkq45" event={"ID":"8c96b805-c16c-471b-997a-fb2a244b7728","Type":"ContainerStarted","Data":"120872f158739614d6dc25c69a31e37c69aa54b5f735d18ce80008a3e2ac99ff"}
Jul 23 18:15:17.513980 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.513917    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8ddd58c4f-bkq45" podStartSLOduration=2.159911723 podStartE2EDuration="2.513894936s" totalImagesPullingTime="353.983213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:15:17.513108361 +0000 UTC m=+779.925811235" watchObservedRunningTime="2026-07-23 18:15:17.513894936 +0000 UTC m=+779.926597724"
Jul 23 18:15:17.560005 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.559967    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f6858b8d-qckgh"]
Jul 23 18:15:17.560392 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.560358    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5f6858b8d-qckgh" podUID="fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" containerName="authorino" containerID="cri-o://87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3" gracePeriod=30
Jul 23 18:15:17.825088 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.824805    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:15:17.962384 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.962354    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfk6k\" (UniqueName: \"kubernetes.io/projected/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-kube-api-access-jfk6k\") pod \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") "
Jul 23 18:15:17.962586 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.962436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-tls-cert\") pod \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\" (UID: \"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa\") "
Jul 23 18:15:17.964525 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.964490    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-kube-api-access-jfk6k" (OuterVolumeSpecName: "kube-api-access-jfk6k") pod "fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" (UID: "fad5f616-70c6-49d5-b6da-4f2f3c8c72aa"). InnerVolumeSpecName "kube-api-access-jfk6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:15:17.972768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:17.972743    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" (UID: "fad5f616-70c6-49d5-b6da-4f2f3c8c72aa"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:15:18.063266 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.063233    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfk6k\" (UniqueName: \"kubernetes.io/projected/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-kube-api-access-jfk6k\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:15:18.063266 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.063266    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa-tls-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:15:18.493788 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.493699    2578 generic.go:356] "Generic (PLEG): container finished" podID="fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" containerID="87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3" exitCode=0
Jul 23 18:15:18.493788 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.493763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6858b8d-qckgh"
Jul 23 18:15:18.494278 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.493793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6858b8d-qckgh" event={"ID":"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa","Type":"ContainerDied","Data":"87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3"}
Jul 23 18:15:18.494278 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.493847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6858b8d-qckgh" event={"ID":"fad5f616-70c6-49d5-b6da-4f2f3c8c72aa","Type":"ContainerDied","Data":"ad016c62e1d2edc96f125e552141cfd77cc89ebdce4262889564a6894da51e1a"}
Jul 23 18:15:18.494278 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.493871    2578 scope.go:117] "RemoveContainer" containerID="87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3"
Jul 23 18:15:18.502547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.502529    2578 scope.go:117] "RemoveContainer" containerID="87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3"
Jul 23 18:15:18.502796 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:15:18.502776    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3\": container with ID starting with 87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3 not found: ID does not exist" containerID="87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3"
Jul 23 18:15:18.502853 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.502804    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3"} err="failed to get container status \"87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3\": rpc error: code = NotFound desc = could not find container \"87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3\": container with ID starting with 87480263d0ef87acd1047f9869c391375af56c92e5f036bca28d0183f96ee3f3 not found: ID does not exist"
Jul 23 18:15:18.511383 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.511360    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f6858b8d-qckgh"]
Jul 23 18:15:18.515883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:18.515855    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f6858b8d-qckgh"]
Jul 23 18:15:20.122740 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:15:20.122708    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" path="/var/lib/kubelet/pods/fad5f616-70c6-49d5-b6da-4f2f3c8c72aa/volumes"
Jul 23 18:16:04.002035 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.001942    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-5982x"]
Jul 23 18:16:04.002602 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.002188    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76f757f7f7-5982x" podUID="5f62ec1c-64c2-404b-be9b-ffb8f7175c51" containerName="manager" containerID="cri-o://e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43" gracePeriod=30
Jul 23 18:16:04.254157 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.254097    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:16:04.373290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.373248    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert\") pod \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") "
Jul 23 18:16:04.373467 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.373328    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29f62\" (UniqueName: \"kubernetes.io/projected/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-kube-api-access-29f62\") pod \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\" (UID: \"5f62ec1c-64c2-404b-be9b-ffb8f7175c51\") "
Jul 23 18:16:04.375469 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.375432    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5f62ec1c-64c2-404b-be9b-ffb8f7175c51" (UID: "5f62ec1c-64c2-404b-be9b-ffb8f7175c51"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:16:04.375469 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.375436    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-kube-api-access-29f62" (OuterVolumeSpecName: "kube-api-access-29f62") pod "5f62ec1c-64c2-404b-be9b-ffb8f7175c51" (UID: "5f62ec1c-64c2-404b-be9b-ffb8f7175c51"). InnerVolumeSpecName "kube-api-access-29f62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:16:04.474316 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.474273    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-webhook-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:16:04.474316 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.474311    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29f62\" (UniqueName: \"kubernetes.io/projected/5f62ec1c-64c2-404b-be9b-ffb8f7175c51-kube-api-access-29f62\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:16:04.705401 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.705369    2578 generic.go:356] "Generic (PLEG): container finished" podID="5f62ec1c-64c2-404b-be9b-ffb8f7175c51" containerID="e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43" exitCode=0
Jul 23 18:16:04.705580 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.705435    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-5982x"
Jul 23 18:16:04.705580 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.705436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-5982x" event={"ID":"5f62ec1c-64c2-404b-be9b-ffb8f7175c51","Type":"ContainerDied","Data":"e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43"}
Jul 23 18:16:04.705580 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.705577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-5982x" event={"ID":"5f62ec1c-64c2-404b-be9b-ffb8f7175c51","Type":"ContainerDied","Data":"35fed50c488510e04ed70d562eefefedf52cd46ae6217fbc624250a87ea47253"}
Jul 23 18:16:04.705690 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.705601    2578 scope.go:117] "RemoveContainer" containerID="e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43"
Jul 23 18:16:04.714475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.714460    2578 scope.go:117] "RemoveContainer" containerID="e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43"
Jul 23 18:16:04.714731 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:16:04.714712    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43\": container with ID starting with e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43 not found: ID does not exist" containerID="e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43"
Jul 23 18:16:04.714783 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.714738    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43"} err="failed to get container status \"e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43\": rpc error: code = NotFound desc = could not find container \"e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43\": container with ID starting with e19e7631f35987f1e3934614f2f30019e417b2c81c6511fd72d493c263ad9b43 not found: ID does not exist"
Jul 23 18:16:04.728503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.728483    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-5982x"]
Jul 23 18:16:04.732345 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:04.732323    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-5982x"]
Jul 23 18:16:06.121267 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:16:06.121226    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f62ec1c-64c2-404b-be9b-ffb8f7175c51" path="/var/lib/kubelet/pods/5f62ec1c-64c2-404b-be9b-ffb8f7175c51/volumes"
Jul 23 18:17:05.612225 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612194    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76f757f7f7-xjsfx"]
Jul 23 18:17:05.612739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612558    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f62ec1c-64c2-404b-be9b-ffb8f7175c51" containerName="manager"
Jul 23 18:17:05.612739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612569    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f62ec1c-64c2-404b-be9b-ffb8f7175c51" containerName="manager"
Jul 23 18:17:05.612739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612583    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" containerName="authorino"
Jul 23 18:17:05.612739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612588    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" containerName="authorino"
Jul 23 18:17:05.612739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612648    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f62ec1c-64c2-404b-be9b-ffb8f7175c51" containerName="manager"
Jul 23 18:17:05.612739 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.612659    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad5f616-70c6-49d5-b6da-4f2f3c8c72aa" containerName="authorino"
Jul 23 18:17:05.615515 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.615499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.619546 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.619526    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-82546\""
Jul 23 18:17:05.619546 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.619543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:17:05.619546 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.619553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:17:05.625140 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.625119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-xjsfx"]
Jul 23 18:17:05.689806 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.689744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-webhook-cert\") pod \"maas-controller-76f757f7f7-xjsfx\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") " pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.689906 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.689854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx9gt\" (UniqueName: \"kubernetes.io/projected/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-kube-api-access-bx9gt\") pod \"maas-controller-76f757f7f7-xjsfx\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") " pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.790893 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.790867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-webhook-cert\") pod \"maas-controller-76f757f7f7-xjsfx\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") " pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.791015 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.790920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx9gt\" (UniqueName: \"kubernetes.io/projected/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-kube-api-access-bx9gt\") pod \"maas-controller-76f757f7f7-xjsfx\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") " pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.793080 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.793062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-webhook-cert\") pod \"maas-controller-76f757f7f7-xjsfx\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") " pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.801039 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.801012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx9gt\" (UniqueName: \"kubernetes.io/projected/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-kube-api-access-bx9gt\") pod \"maas-controller-76f757f7f7-xjsfx\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") " pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:05.950078 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:05.950007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:06.081183 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:06.081160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-xjsfx"]
Jul 23 18:17:06.083046 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:17:06.083017    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49344a3e_5ea6_4b4e_ad1c_c8c2e0eecb0b.slice/crio-7da501696daf4460155b4ff04cd01ab31b2d0115c7b9b6e0fb97b3b54770976a WatchSource:0}: Error finding container 7da501696daf4460155b4ff04cd01ab31b2d0115c7b9b6e0fb97b3b54770976a: Status 404 returned error can't find the container with id 7da501696daf4460155b4ff04cd01ab31b2d0115c7b9b6e0fb97b3b54770976a
Jul 23 18:17:06.998163 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:06.998117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-xjsfx" event={"ID":"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b","Type":"ContainerStarted","Data":"7da501696daf4460155b4ff04cd01ab31b2d0115c7b9b6e0fb97b3b54770976a"}
Jul 23 18:17:08.004175 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:08.004069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-xjsfx" event={"ID":"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b","Type":"ContainerStarted","Data":"ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70"}
Jul 23 18:17:08.004175 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:08.004136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:08.025637 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:08.025595    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76f757f7f7-xjsfx" podStartSLOduration=1.386239121 podStartE2EDuration="3.02557992s" totalImagesPullingTime="1.639340799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:08.023339943 +0000 UTC m=+890.436042732" watchObservedRunningTime="2026-07-23 18:17:08.02557992 +0000 UTC m=+890.438282731"
Jul 23 18:17:19.011459 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:19.011402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:23.680477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:23.680446    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-xjsfx"]
Jul 23 18:17:23.680931 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:23.680647    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76f757f7f7-xjsfx" podUID="49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" containerName="manager" containerID="cri-o://ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70" gracePeriod=30
Jul 23 18:17:23.932643 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:23.932591    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:24.049057 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.049026    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-webhook-cert\") pod \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") "
Jul 23 18:17:24.049244 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.049096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx9gt\" (UniqueName: \"kubernetes.io/projected/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-kube-api-access-bx9gt\") pod \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\" (UID: \"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b\") "
Jul 23 18:17:24.051102 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.051074    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" (UID: "49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:17:24.051201 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.051138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-kube-api-access-bx9gt" (OuterVolumeSpecName: "kube-api-access-bx9gt") pod "49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" (UID: "49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b"). InnerVolumeSpecName "kube-api-access-bx9gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:17:24.082798 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.082762    2578 generic.go:356] "Generic (PLEG): container finished" podID="49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" containerID="ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70" exitCode=0
Jul 23 18:17:24.082919 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.082799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-xjsfx" event={"ID":"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b","Type":"ContainerDied","Data":"ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70"}
Jul 23 18:17:24.082919 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.082849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-xjsfx" event={"ID":"49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b","Type":"ContainerDied","Data":"7da501696daf4460155b4ff04cd01ab31b2d0115c7b9b6e0fb97b3b54770976a"}
Jul 23 18:17:24.082919 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.082801    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-xjsfx"
Jul 23 18:17:24.083043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.082878    2578 scope.go:117] "RemoveContainer" containerID="ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70"
Jul 23 18:17:24.091432 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.091385    2578 scope.go:117] "RemoveContainer" containerID="ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70"
Jul 23 18:17:24.091669 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:17:24.091652    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70\": container with ID starting with ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70 not found: ID does not exist" containerID="ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70"
Jul 23 18:17:24.091720 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.091679    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70"} err="failed to get container status \"ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70\": rpc error: code = NotFound desc = could not find container \"ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70\": container with ID starting with ab11a37a0012ef8bc90d87757657e36508f2d426a31fb9a8fe79b80d1b36eb70 not found: ID does not exist"
Jul 23 18:17:24.108022 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.107999    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-xjsfx"]
Jul 23 18:17:24.113786 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.113767    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-xjsfx"]
Jul 23 18:17:24.121629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.121609    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" path="/var/lib/kubelet/pods/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b/volumes"
Jul 23 18:17:24.150034 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.150016    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx9gt\" (UniqueName: \"kubernetes.io/projected/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-kube-api-access-bx9gt\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:17:24.150111 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.150037    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b-webhook-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:17:24.932654 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.932624    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76f757f7f7-qx78t"]
Jul 23 18:17:24.933089 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.933043    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" containerName="manager"
Jul 23 18:17:24.933089 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.933058    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" containerName="manager"
Jul 23 18:17:24.933189 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.933114    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49344a3e-5ea6-4b4e-ad1c-c8c2e0eecb0b" containerName="manager"
Jul 23 18:17:24.937277 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.937257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:24.940066 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.940048    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:17:24.940185 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.940125    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:17:24.941387 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.941370    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-82546\""
Jul 23 18:17:24.945472 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:24.945451    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-qx78t"]
Jul 23 18:17:25.058543 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.058508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2bn\" (UniqueName: \"kubernetes.io/projected/887a6cb9-f789-4142-b137-e4d2434dc77f-kube-api-access-zj2bn\") pod \"maas-controller-76f757f7f7-qx78t\" (UID: \"887a6cb9-f789-4142-b137-e4d2434dc77f\") " pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.058708 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.058624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887a6cb9-f789-4142-b137-e4d2434dc77f-webhook-cert\") pod \"maas-controller-76f757f7f7-qx78t\" (UID: \"887a6cb9-f789-4142-b137-e4d2434dc77f\") " pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.159629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.159598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2bn\" (UniqueName: \"kubernetes.io/projected/887a6cb9-f789-4142-b137-e4d2434dc77f-kube-api-access-zj2bn\") pod \"maas-controller-76f757f7f7-qx78t\" (UID: \"887a6cb9-f789-4142-b137-e4d2434dc77f\") " pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.159790 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.159701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887a6cb9-f789-4142-b137-e4d2434dc77f-webhook-cert\") pod \"maas-controller-76f757f7f7-qx78t\" (UID: \"887a6cb9-f789-4142-b137-e4d2434dc77f\") " pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.162102 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.162077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/887a6cb9-f789-4142-b137-e4d2434dc77f-webhook-cert\") pod \"maas-controller-76f757f7f7-qx78t\" (UID: \"887a6cb9-f789-4142-b137-e4d2434dc77f\") " pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.169097 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.169078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2bn\" (UniqueName: \"kubernetes.io/projected/887a6cb9-f789-4142-b137-e4d2434dc77f-kube-api-access-zj2bn\") pod \"maas-controller-76f757f7f7-qx78t\" (UID: \"887a6cb9-f789-4142-b137-e4d2434dc77f\") " pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.248639 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.248581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:25.376534 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:25.376373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76f757f7f7-qx78t"]
Jul 23 18:17:25.379212 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:17:25.379179    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887a6cb9_f789_4142_b137_e4d2434dc77f.slice/crio-102d750befc429ec3ae235efbcca02c08d97fffc9b267c528f112f8e73342ed2 WatchSource:0}: Error finding container 102d750befc429ec3ae235efbcca02c08d97fffc9b267c528f112f8e73342ed2: Status 404 returned error can't find the container with id 102d750befc429ec3ae235efbcca02c08d97fffc9b267c528f112f8e73342ed2
Jul 23 18:17:26.094334 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:26.094292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-qx78t" event={"ID":"887a6cb9-f789-4142-b137-e4d2434dc77f","Type":"ContainerStarted","Data":"5cb52df4778111d8ef2804486461731b5e1d1eb8f66a0d168446e4b797cc40c6"}
Jul 23 18:17:26.094732 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:26.094387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76f757f7f7-qx78t" event={"ID":"887a6cb9-f789-4142-b137-e4d2434dc77f","Type":"ContainerStarted","Data":"102d750befc429ec3ae235efbcca02c08d97fffc9b267c528f112f8e73342ed2"}
Jul 23 18:17:26.094732 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:26.094457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:17:26.116562 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:26.116514    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76f757f7f7-qx78t" podStartSLOduration=1.728406123 podStartE2EDuration="2.116501613s" totalImagesPullingTime="388.09549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:26.114848119 +0000 UTC m=+908.527550909" watchObservedRunningTime="2026-07-23 18:17:26.116501613 +0000 UTC m=+908.529204433"
Jul 23 18:17:37.101461 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:17:37.101430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76f757f7f7-qx78t"
Jul 23 18:26:24.913888 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.913845    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"]
Jul 23 18:26:24.917598 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.917575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:24.920680 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.920659    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4ade9fda-kserve-self-signed-certs\""
Jul 23 18:26:24.940900 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.940878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"]
Jul 23 18:26:24.968890 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.968866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-model-cache\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:24.969032 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.968899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tmp-dir\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:24.969032 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.968945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-home\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:24.969032 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.968965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tls-certs\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:24.969032 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.968987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5hl\" (UniqueName: \"kubernetes.io/projected/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-kube-api-access-wx5hl\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:24.969159 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:24.969041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-dshm\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070050 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-dshm\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070234 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-model-cache\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070234 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tmp-dir\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070342 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-home\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070342 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tls-certs\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5hl\" (UniqueName: \"kubernetes.io/projected/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-kube-api-access-wx5hl\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070530 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-model-cache\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070587 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tmp-dir\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.070629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.070608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-home\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.072248 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.072227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-dshm\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.072589 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.072568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tls-certs\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.086098 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.086074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5hl\" (UniqueName: \"kubernetes.io/projected/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-kube-api-access-wx5hl\") pod \"e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") " pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.227120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.227050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:25.361178 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.361154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"]
Jul 23 18:26:25.362979 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:26:25.362950    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1649f0a_7c07_453e_bc9c_f90bf9159c6f.slice/crio-73cba8651d189c7fc0474023c697461c89ce13b1bd19ac5b14acceef820c1b59 WatchSource:0}: Error finding container 73cba8651d189c7fc0474023c697461c89ce13b1bd19ac5b14acceef820c1b59: Status 404 returned error can't find the container with id 73cba8651d189c7fc0474023c697461c89ce13b1bd19ac5b14acceef820c1b59
Jul 23 18:26:25.633927 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.633893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff" event={"ID":"f1649f0a-7c07-453e-bc9c-f90bf9159c6f","Type":"ContainerStarted","Data":"af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187"}
Jul 23 18:26:25.633927 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.633933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff" event={"ID":"f1649f0a-7c07-453e-bc9c-f90bf9159c6f","Type":"ContainerStarted","Data":"73cba8651d189c7fc0474023c697461c89ce13b1bd19ac5b14acceef820c1b59"}
Jul 23 18:26:25.652631 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:25.652587    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff" podStartSLOduration=1.652573558 podStartE2EDuration="1.652573558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:25.652065771 +0000 UTC m=+1448.064768564" watchObservedRunningTime="2026-07-23 18:26:25.652573558 +0000 UTC m=+1448.065276346"
Jul 23 18:26:35.227224 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:35.227135    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:35.227224 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:35.227214    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:35.240154 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:35.240136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:35.693041 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:35.693015    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:26:35.994944 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:35.994859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"]
Jul 23 18:26:35.998658 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:35.998637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.001194 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.001173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4ade9fda-kserve-self-signed-certs\""
Jul 23 18:26:36.007969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.007942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"]
Jul 23 18:26:36.072363 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.072341    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af021570-7b62-4e4a-96f4-8210dac02817-tls-certs\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.072503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.072381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-tmp-dir\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.072503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.072439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-dshm\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.072503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.072469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzfvl\" (UniqueName: \"kubernetes.io/projected/af021570-7b62-4e4a-96f4-8210dac02817-kube-api-access-gzfvl\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.072608 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.072504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-home\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.072608 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.072566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-model-cache\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.173851 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.173828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-home\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.173970 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.173878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-model-cache\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.173970 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.173920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af021570-7b62-4e4a-96f4-8210dac02817-tls-certs\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.173970 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.173960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-tmp-dir\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.174123 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.174006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-dshm\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.174123 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.174048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfvl\" (UniqueName: \"kubernetes.io/projected/af021570-7b62-4e4a-96f4-8210dac02817-kube-api-access-gzfvl\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.174285 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.174260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-home\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.174458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.174306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-model-cache\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.174458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.174340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-tmp-dir\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.176243 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.176221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-dshm\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.176485 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.176467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af021570-7b62-4e4a-96f4-8210dac02817-tls-certs\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.184252 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.184229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzfvl\" (UniqueName: \"kubernetes.io/projected/af021570-7b62-4e4a-96f4-8210dac02817-kube-api-access-gzfvl\") pod \"e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") " pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.309084 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.309051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:36.440589 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.440563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"]
Jul 23 18:26:36.441666 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:26:36.441639    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf021570_7b62_4e4a_96f4_8210dac02817.slice/crio-c7f2ba5b7fdf07abee53bb62fe1b91d5a987cc9cf80c92f89408e85b2b36d146 WatchSource:0}: Error finding container c7f2ba5b7fdf07abee53bb62fe1b91d5a987cc9cf80c92f89408e85b2b36d146: Status 404 returned error can't find the container with id c7f2ba5b7fdf07abee53bb62fe1b91d5a987cc9cf80c92f89408e85b2b36d146
Jul 23 18:26:36.694502 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.694397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g" event={"ID":"af021570-7b62-4e4a-96f4-8210dac02817","Type":"ContainerStarted","Data":"2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c"}
Jul 23 18:26:36.694502 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.694465    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g" event={"ID":"af021570-7b62-4e4a-96f4-8210dac02817","Type":"ContainerStarted","Data":"c7f2ba5b7fdf07abee53bb62fe1b91d5a987cc9cf80c92f89408e85b2b36d146"}
Jul 23 18:26:36.713674 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:36.713630    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g" podStartSLOduration=1.7136158959999999 podStartE2EDuration="1.713615896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:36.712333646 +0000 UTC m=+1459.125036434" watchObservedRunningTime="2026-07-23 18:26:36.713615896 +0000 UTC m=+1459.126318684"
Jul 23 18:26:46.310100 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:46.310063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:46.310100 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:46.310110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:46.322503 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:46.322480    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:26:46.752495 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:26:46.752426    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:27:04.497250 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:04.497215    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"]
Jul 23 18:27:05.929345 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:05.929307    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"]
Jul 23 18:27:19.518332 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.518293    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff" podUID="f1649f0a-7c07-453e-bc9c-f90bf9159c6f" containerName="main" containerID="cri-o://af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187" gracePeriod=45
Jul 23 18:27:19.770027 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.769977    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:27:19.850941 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.850913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-model-cache\") pod \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") "
Jul 23 18:27:19.851085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.850965    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx5hl\" (UniqueName: \"kubernetes.io/projected/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-kube-api-access-wx5hl\") pod \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") "
Jul 23 18:27:19.851085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tmp-dir\") pod \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") "
Jul 23 18:27:19.851085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851037    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-dshm\") pod \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") "
Jul 23 18:27:19.851085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-home\") pod \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") "
Jul 23 18:27:19.851300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tls-certs\") pod \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\" (UID: \"f1649f0a-7c07-453e-bc9c-f90bf9159c6f\") "
Jul 23 18:27:19.851300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851189    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1649f0a-7c07-453e-bc9c-f90bf9159c6f" (UID: "f1649f0a-7c07-453e-bc9c-f90bf9159c6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:19.851392 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f1649f0a-7c07-453e-bc9c-f90bf9159c6f" (UID: "f1649f0a-7c07-453e-bc9c-f90bf9159c6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:19.851392 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-home" (OuterVolumeSpecName: "home") pod "f1649f0a-7c07-453e-bc9c-f90bf9159c6f" (UID: "f1649f0a-7c07-453e-bc9c-f90bf9159c6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:19.851491 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851431    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:19.851491 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851450    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:19.851491 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.851460    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:19.853222 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.853199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-dshm" (OuterVolumeSpecName: "dshm") pod "f1649f0a-7c07-453e-bc9c-f90bf9159c6f" (UID: "f1649f0a-7c07-453e-bc9c-f90bf9159c6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:19.853284 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.853262    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f1649f0a-7c07-453e-bc9c-f90bf9159c6f" (UID: "f1649f0a-7c07-453e-bc9c-f90bf9159c6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:27:19.853328 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.853314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-kube-api-access-wx5hl" (OuterVolumeSpecName: "kube-api-access-wx5hl") pod "f1649f0a-7c07-453e-bc9c-f90bf9159c6f" (UID: "f1649f0a-7c07-453e-bc9c-f90bf9159c6f"). InnerVolumeSpecName "kube-api-access-wx5hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:27:19.903626 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.903600    2578 generic.go:356] "Generic (PLEG): container finished" podID="f1649f0a-7c07-453e-bc9c-f90bf9159c6f" containerID="af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187" exitCode=0
Jul 23 18:27:19.903728 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.903650    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"
Jul 23 18:27:19.903728 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.903686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff" event={"ID":"f1649f0a-7c07-453e-bc9c-f90bf9159c6f","Type":"ContainerDied","Data":"af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187"}
Jul 23 18:27:19.903797 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.903728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff" event={"ID":"f1649f0a-7c07-453e-bc9c-f90bf9159c6f","Type":"ContainerDied","Data":"73cba8651d189c7fc0474023c697461c89ce13b1bd19ac5b14acceef820c1b59"}
Jul 23 18:27:19.903797 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.903745    2578 scope.go:117] "RemoveContainer" containerID="af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187"
Jul 23 18:27:19.912672 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.912653    2578 scope.go:117] "RemoveContainer" containerID="af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187"
Jul 23 18:27:19.912942 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:27:19.912920    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187\": container with ID starting with af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187 not found: ID does not exist" containerID="af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187"
Jul 23 18:27:19.913010 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.912953    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187"} err="failed to get container status \"af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187\": rpc error: code = NotFound desc = could not find container \"af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187\": container with ID starting with af4764d6e1e5351433e99bfdeadd6c666d683b7f2c984b4dbe75db2664f60187 not found: ID does not exist"
Jul 23 18:27:19.926384 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.926363    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"]
Jul 23 18:27:19.928953 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.928934    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4ade9fda-kserve-6b54659c95-xvmff"]
Jul 23 18:27:19.952322 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.952301    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx5hl\" (UniqueName: \"kubernetes.io/projected/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-kube-api-access-wx5hl\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:19.952322 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.952319    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:19.952463 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:19.952329    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1649f0a-7c07-453e-bc9c-f90bf9159c6f-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:20.122331 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:20.122302    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1649f0a-7c07-453e-bc9c-f90bf9159c6f" path="/var/lib/kubelet/pods/f1649f0a-7c07-453e-bc9c-f90bf9159c6f/volumes"
Jul 23 18:27:20.949908 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:20.949856    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g" podUID="af021570-7b62-4e4a-96f4-8210dac02817" containerName="main" containerID="cri-o://2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c" gracePeriod=45
Jul 23 18:27:21.207642 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.207586    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:27:21.373033 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373004    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-home\") pod \"af021570-7b62-4e4a-96f4-8210dac02817\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") "
Jul 23 18:27:21.373247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-model-cache\") pod \"af021570-7b62-4e4a-96f4-8210dac02817\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") "
Jul 23 18:27:21.373247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-dshm\") pod \"af021570-7b62-4e4a-96f4-8210dac02817\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") "
Jul 23 18:27:21.373247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373140    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzfvl\" (UniqueName: \"kubernetes.io/projected/af021570-7b62-4e4a-96f4-8210dac02817-kube-api-access-gzfvl\") pod \"af021570-7b62-4e4a-96f4-8210dac02817\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") "
Jul 23 18:27:21.373247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373171    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-tmp-dir\") pod \"af021570-7b62-4e4a-96f4-8210dac02817\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") "
Jul 23 18:27:21.373247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373202    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af021570-7b62-4e4a-96f4-8210dac02817-tls-certs\") pod \"af021570-7b62-4e4a-96f4-8210dac02817\" (UID: \"af021570-7b62-4e4a-96f4-8210dac02817\") "
Jul 23 18:27:21.373523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373262    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-home" (OuterVolumeSpecName: "home") pod "af021570-7b62-4e4a-96f4-8210dac02817" (UID: "af021570-7b62-4e4a-96f4-8210dac02817"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:21.373523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373459    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:21.373523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373454    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-model-cache" (OuterVolumeSpecName: "model-cache") pod "af021570-7b62-4e4a-96f4-8210dac02817" (UID: "af021570-7b62-4e4a-96f4-8210dac02817"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:21.373523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.373498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af021570-7b62-4e4a-96f4-8210dac02817" (UID: "af021570-7b62-4e4a-96f4-8210dac02817"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:21.375308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.375268    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af021570-7b62-4e4a-96f4-8210dac02817-kube-api-access-gzfvl" (OuterVolumeSpecName: "kube-api-access-gzfvl") pod "af021570-7b62-4e4a-96f4-8210dac02817" (UID: "af021570-7b62-4e4a-96f4-8210dac02817"). InnerVolumeSpecName "kube-api-access-gzfvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:27:21.375308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.375286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-dshm" (OuterVolumeSpecName: "dshm") pod "af021570-7b62-4e4a-96f4-8210dac02817" (UID: "af021570-7b62-4e4a-96f4-8210dac02817"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:21.375477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.375309    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af021570-7b62-4e4a-96f4-8210dac02817-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af021570-7b62-4e4a-96f4-8210dac02817" (UID: "af021570-7b62-4e4a-96f4-8210dac02817"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:27:21.474823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.474766    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzfvl\" (UniqueName: \"kubernetes.io/projected/af021570-7b62-4e4a-96f4-8210dac02817-kube-api-access-gzfvl\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:21.474823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.474787    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:21.474823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.474798    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af021570-7b62-4e4a-96f4-8210dac02817-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:21.474823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.474806    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:21.474823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.474814    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af021570-7b62-4e4a-96f4-8210dac02817-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:27:21.914825 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.914795    2578 generic.go:356] "Generic (PLEG): container finished" podID="af021570-7b62-4e4a-96f4-8210dac02817" containerID="2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c" exitCode=0
Jul 23 18:27:21.914993 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.914845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"
Jul 23 18:27:21.914993 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.914849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g" event={"ID":"af021570-7b62-4e4a-96f4-8210dac02817","Type":"ContainerDied","Data":"2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c"}
Jul 23 18:27:21.914993 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.914885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g" event={"ID":"af021570-7b62-4e4a-96f4-8210dac02817","Type":"ContainerDied","Data":"c7f2ba5b7fdf07abee53bb62fe1b91d5a987cc9cf80c92f89408e85b2b36d146"}
Jul 23 18:27:21.914993 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.914902    2578 scope.go:117] "RemoveContainer" containerID="2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c"
Jul 23 18:27:21.923605 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.923589    2578 scope.go:117] "RemoveContainer" containerID="2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c"
Jul 23 18:27:21.923857 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:27:21.923837    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c\": container with ID starting with 2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c not found: ID does not exist" containerID="2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c"
Jul 23 18:27:21.923919 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.923865    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c"} err="failed to get container status \"2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c\": rpc error: code = NotFound desc = could not find container \"2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c\": container with ID starting with 2064580c30cdec8808031516ea89bf77d00c50e815656cf6cd1f9ca6adf5993c not found: ID does not exist"
Jul 23 18:27:21.937453 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.937428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"]
Jul 23 18:27:21.941605 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:21.941584    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4ade9fda-kserve-6975746bff-xz55g"]
Jul 23 18:27:22.121382 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:27:22.121356    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af021570-7b62-4e4a-96f4-8210dac02817" path="/var/lib/kubelet/pods/af021570-7b62-4e4a-96f4-8210dac02817/volumes"
Jul 23 18:36:53.400834 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.400760    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"]
Jul 23 18:36:53.401274 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.401258    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af021570-7b62-4e4a-96f4-8210dac02817" containerName="main"
Jul 23 18:36:53.401320 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.401277    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af021570-7b62-4e4a-96f4-8210dac02817" containerName="main"
Jul 23 18:36:53.401320 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.401288    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1649f0a-7c07-453e-bc9c-f90bf9159c6f" containerName="main"
Jul 23 18:36:53.401320 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.401293    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1649f0a-7c07-453e-bc9c-f90bf9159c6f" containerName="main"
Jul 23 18:36:53.401444 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.401359    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1649f0a-7c07-453e-bc9c-f90bf9159c6f" containerName="main"
Jul 23 18:36:53.401444 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.401376    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="af021570-7b62-4e4a-96f4-8210dac02817" containerName="main"
Jul 23 18:36:53.404757 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.404737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.409290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.409262    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a06c87e8\"/\"openshift-service-ca.crt\""
Jul 23 18:36:53.409847 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.409773    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a06c87e8\"/\"kube-root-ca.crt\""
Jul 23 18:36:53.409847 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.409773    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a06c87e8\"/\"e2e-lifecycle-model-a06c87e8-kserve-self-signed-certs\""
Jul 23 18:36:53.410053 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.410028    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a06c87e8\"/\"default-dockercfg-ltjfr\""
Jul 23 18:36:53.416517 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.416490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"]
Jul 23 18:36:53.495617 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.495587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-dshm\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.495617 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.495618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-tmp-dir\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.495798 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.495707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-home\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.495798 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.495747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqs6\" (UniqueName: \"kubernetes.io/projected/8c435470-c94e-4589-a4a7-7180656a1ae0-kube-api-access-qcqs6\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.495798 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.495770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-model-cache\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.495898 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.495819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c435470-c94e-4589-a4a7-7180656a1ae0-tls-certs\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.596582 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.596549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-home\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.596582 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.596581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqs6\" (UniqueName: \"kubernetes.io/projected/8c435470-c94e-4589-a4a7-7180656a1ae0-kube-api-access-qcqs6\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.596768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.596600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-model-cache\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.596768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.596640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c435470-c94e-4589-a4a7-7180656a1ae0-tls-certs\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.596768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.596677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-dshm\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.596768 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.596692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-tmp-dir\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.597022 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.597003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-home\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.597087 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.597068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-model-cache\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.597170 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.597100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-tmp-dir\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.598893 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.598872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-dshm\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.599146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.599129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c435470-c94e-4589-a4a7-7180656a1ae0-tls-certs\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.606837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.606815    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqs6\" (UniqueName: \"kubernetes.io/projected/8c435470-c94e-4589-a4a7-7180656a1ae0-kube-api-access-qcqs6\") pod \"e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") " pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.717623 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.717559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:36:53.852892 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:53.852801    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"]
Jul 23 18:36:53.855285 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:36:53.855259    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c435470_c94e_4589_a4a7_7180656a1ae0.slice/crio-d176d908a96e64d26489a9a757b7159a40bf70bc58abcad6c7d2a1f11c9372f9 WatchSource:0}: Error finding container d176d908a96e64d26489a9a757b7159a40bf70bc58abcad6c7d2a1f11c9372f9: Status 404 returned error can't find the container with id d176d908a96e64d26489a9a757b7159a40bf70bc58abcad6c7d2a1f11c9372f9
Jul 23 18:36:54.582275 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:54.582243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992" event={"ID":"8c435470-c94e-4589-a4a7-7180656a1ae0","Type":"ContainerStarted","Data":"9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779"}
Jul 23 18:36:54.582275 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:54.582284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992" event={"ID":"8c435470-c94e-4589-a4a7-7180656a1ae0","Type":"ContainerStarted","Data":"d176d908a96e64d26489a9a757b7159a40bf70bc58abcad6c7d2a1f11c9372f9"}
Jul 23 18:36:54.604276 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:36:54.604223    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992" podStartSLOduration=1.6042095509999998 podStartE2EDuration="1.604209551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:54.603048693 +0000 UTC m=+2077.015751482" watchObservedRunningTime="2026-07-23 18:36:54.604209551 +0000 UTC m=+2077.016912339"
Jul 23 18:37:03.717828 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:03.717776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:37:03.718215 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:03.717839    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:37:03.730684 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:03.730651    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:37:04.641636 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:04.641604    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:37:40.141192 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:40.141161    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"]
Jul 23 18:37:55.161060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.160996    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992" podUID="8c435470-c94e-4589-a4a7-7180656a1ae0" containerName="main" containerID="cri-o://9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779" gracePeriod=45
Jul 23 18:37:55.399875 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.399849    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:37:55.543632 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543603    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-home\") pod \"8c435470-c94e-4589-a4a7-7180656a1ae0\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") "
Jul 23 18:37:55.543824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543659    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c435470-c94e-4589-a4a7-7180656a1ae0-tls-certs\") pod \"8c435470-c94e-4589-a4a7-7180656a1ae0\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") "
Jul 23 18:37:55.543824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543689    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-dshm\") pod \"8c435470-c94e-4589-a4a7-7180656a1ae0\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") "
Jul 23 18:37:55.543824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcqs6\" (UniqueName: \"kubernetes.io/projected/8c435470-c94e-4589-a4a7-7180656a1ae0-kube-api-access-qcqs6\") pod \"8c435470-c94e-4589-a4a7-7180656a1ae0\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") "
Jul 23 18:37:55.543824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543769    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-tmp-dir\") pod \"8c435470-c94e-4589-a4a7-7180656a1ae0\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") "
Jul 23 18:37:55.543824 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543799    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-model-cache\") pod \"8c435470-c94e-4589-a4a7-7180656a1ae0\" (UID: \"8c435470-c94e-4589-a4a7-7180656a1ae0\") "
Jul 23 18:37:55.544086 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.543901    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-home" (OuterVolumeSpecName: "home") pod "8c435470-c94e-4589-a4a7-7180656a1ae0" (UID: "8c435470-c94e-4589-a4a7-7180656a1ae0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:37:55.544086 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.544018    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c435470-c94e-4589-a4a7-7180656a1ae0" (UID: "8c435470-c94e-4589-a4a7-7180656a1ae0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:37:55.544182 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.544095    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:37:55.544182 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.544112    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:37:55.544182 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.544092    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c435470-c94e-4589-a4a7-7180656a1ae0" (UID: "8c435470-c94e-4589-a4a7-7180656a1ae0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:37:55.546070 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.546047    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-dshm" (OuterVolumeSpecName: "dshm") pod "8c435470-c94e-4589-a4a7-7180656a1ae0" (UID: "8c435470-c94e-4589-a4a7-7180656a1ae0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:37:55.546156 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.546052    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c435470-c94e-4589-a4a7-7180656a1ae0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c435470-c94e-4589-a4a7-7180656a1ae0" (UID: "8c435470-c94e-4589-a4a7-7180656a1ae0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:37:55.546192 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.546146    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c435470-c94e-4589-a4a7-7180656a1ae0-kube-api-access-qcqs6" (OuterVolumeSpecName: "kube-api-access-qcqs6") pod "8c435470-c94e-4589-a4a7-7180656a1ae0" (UID: "8c435470-c94e-4589-a4a7-7180656a1ae0"). InnerVolumeSpecName "kube-api-access-qcqs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:37:55.645300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.645266    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c435470-c94e-4589-a4a7-7180656a1ae0-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:37:55.645300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.645297    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:37:55.645300 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.645308    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcqs6\" (UniqueName: \"kubernetes.io/projected/8c435470-c94e-4589-a4a7-7180656a1ae0-kube-api-access-qcqs6\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:37:55.645571 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.645317    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c435470-c94e-4589-a4a7-7180656a1ae0-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:37:55.867014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.866934    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c435470-c94e-4589-a4a7-7180656a1ae0" containerID="9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779" exitCode=0
Jul 23 18:37:55.867014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.866988    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"
Jul 23 18:37:55.867014 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.866996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992" event={"ID":"8c435470-c94e-4589-a4a7-7180656a1ae0","Type":"ContainerDied","Data":"9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779"}
Jul 23 18:37:55.867247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.867027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992" event={"ID":"8c435470-c94e-4589-a4a7-7180656a1ae0","Type":"ContainerDied","Data":"d176d908a96e64d26489a9a757b7159a40bf70bc58abcad6c7d2a1f11c9372f9"}
Jul 23 18:37:55.867247 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.867044    2578 scope.go:117] "RemoveContainer" containerID="9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779"
Jul 23 18:37:55.875997 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.875977    2578 scope.go:117] "RemoveContainer" containerID="9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779"
Jul 23 18:37:55.876235 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:37:55.876216    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779\": container with ID starting with 9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779 not found: ID does not exist" containerID="9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779"
Jul 23 18:37:55.876291 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.876243    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779"} err="failed to get container status \"9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779\": rpc error: code = NotFound desc = could not find container \"9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779\": container with ID starting with 9dc130221ef872e54cd0441652f0381a696a441dd522e9d9ed17adadd7a78779 not found: ID does not exist"
Jul 23 18:37:55.890904 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.890884    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"]
Jul 23 18:37:55.897224 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:55.897205    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a06c87e8/e2e-lifecycle-model-a06c87e8-kserve-7d74444467-hj992"]
Jul 23 18:37:56.122547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:37:56.122483    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c435470-c94e-4589-a4a7-7180656a1ae0" path="/var/lib/kubelet/pods/8c435470-c94e-4589-a4a7-7180656a1ae0/volumes"
Jul 23 18:39:48.888986 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.888892    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"]
Jul 23 18:39:48.889744 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.889719    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c435470-c94e-4589-a4a7-7180656a1ae0" containerName="main"
Jul 23 18:39:48.889843 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.889747    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c435470-c94e-4589-a4a7-7180656a1ae0" containerName="main"
Jul 23 18:39:48.889943 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.889931    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c435470-c94e-4589-a4a7-7180656a1ae0" containerName="main"
Jul 23 18:39:48.893686 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.893664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:48.896639 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.896612    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-89c000\"/\"kube-root-ca.crt\""
Jul 23 18:39:48.898120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.897845    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-89c000\"/\"default-dockercfg-c5kdw\""
Jul 23 18:39:48.898282 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.898263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-89c000\"/\"openshift-service-ca.crt\""
Jul 23 18:39:48.898377 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.898311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-89c000\"/\"test-model-89c000-kserve-self-signed-certs\""
Jul 23 18:39:48.900491 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.900470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"]
Jul 23 18:39:48.993517 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.993490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-dshm\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:48.993629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.993532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-home\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:48.993669 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.993622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-model-cache\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:48.993669 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.993661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-tmp-dir\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:48.993733 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.993685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d150b80f-42fd-4aa2-8f11-5312eb912034-tls-certs\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:48.993733 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:48.993724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ndp\" (UniqueName: \"kubernetes.io/projected/d150b80f-42fd-4aa2-8f11-5312eb912034-kube-api-access-x7ndp\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094224 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-dshm\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094339 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-home\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094339 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-model-cache\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094339 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-tmp-dir\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094339 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d150b80f-42fd-4aa2-8f11-5312eb912034-tls-certs\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094568 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ndp\" (UniqueName: \"kubernetes.io/projected/d150b80f-42fd-4aa2-8f11-5312eb912034-kube-api-access-x7ndp\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094708 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-model-cache\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094826 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-home\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.094826 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.094808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-tmp-dir\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.096574 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.096552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-dshm\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.096697 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.096682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d150b80f-42fd-4aa2-8f11-5312eb912034-tls-certs\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.104574 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.104552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ndp\" (UniqueName: \"kubernetes.io/projected/d150b80f-42fd-4aa2-8f11-5312eb912034-kube-api-access-x7ndp\") pod \"test-model-89c000-kserve-55dd877cd9-cmpjq\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") " pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.203891 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.203835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:49.343460 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.343431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"]
Jul 23 18:39:49.344388 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:39:49.344358    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd150b80f_42fd_4aa2_8f11_5312eb912034.slice/crio-45d47d6654f1d67b1bf66c1f51c4afd256bb1c1a79a01e42ad4a0b8393e648a6 WatchSource:0}: Error finding container 45d47d6654f1d67b1bf66c1f51c4afd256bb1c1a79a01e42ad4a0b8393e648a6: Status 404 returned error can't find the container with id 45d47d6654f1d67b1bf66c1f51c4afd256bb1c1a79a01e42ad4a0b8393e648a6
Jul 23 18:39:49.401305 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:49.401271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq" event={"ID":"d150b80f-42fd-4aa2-8f11-5312eb912034","Type":"ContainerStarted","Data":"45d47d6654f1d67b1bf66c1f51c4afd256bb1c1a79a01e42ad4a0b8393e648a6"}
Jul 23 18:39:50.407236 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:50.407193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq" event={"ID":"d150b80f-42fd-4aa2-8f11-5312eb912034","Type":"ContainerStarted","Data":"10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c"}
Jul 23 18:39:50.428105 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:50.428058    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq" podStartSLOduration=2.428043891 podStartE2EDuration="2.428043891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:50.426955014 +0000 UTC m=+2252.839657804" watchObservedRunningTime="2026-07-23 18:39:50.428043891 +0000 UTC m=+2252.840746678"
Jul 23 18:39:59.204725 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:59.204692    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:59.204725 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:59.204734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:59.217172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:59.217150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:39:59.466804 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:39:59.466715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:40:10.812943 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.812908    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"]
Jul 23 18:40:10.816283 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.816264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.820298 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.820272    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fa8ad7\"/\"openshift-service-ca.crt\""
Jul 23 18:40:10.820439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.820299    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fa8ad7\"/\"kube-root-ca.crt\""
Jul 23 18:40:10.820439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.820300    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fa8ad7\"/\"default-dockercfg-qjgph\""
Jul 23 18:40:10.820439 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.820299    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fa8ad7\"/\"test-model-fa8ad7-kserve-self-signed-certs\""
Jul 23 18:40:10.826248 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.826224    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"]
Jul 23 18:40:10.863585 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.863557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-home\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.863707 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.863608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-dshm\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.863707 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.863680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-model-cache\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.863822 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.863802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tls-certs\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.863866 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.863839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tmp-dir\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.863909 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.863895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvc9p\" (UniqueName: \"kubernetes.io/projected/740222aa-3f7b-4d46-991f-98d34c9b3f4c-kube-api-access-vvc9p\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.964905 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.964877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-dshm\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965003 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.964923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-model-cache\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965003 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.964976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tls-certs\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.965001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tmp-dir\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.965026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvc9p\" (UniqueName: \"kubernetes.io/projected/740222aa-3f7b-4d46-991f-98d34c9b3f4c-kube-api-access-vvc9p\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.965059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-home\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965378 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.965355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-model-cache\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965480 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.965377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tmp-dir\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.965480 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.965437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-home\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.967071 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.967051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-dshm\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.967434 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.967395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tls-certs\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:10.975020 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:10.974997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvc9p\" (UniqueName: \"kubernetes.io/projected/740222aa-3f7b-4d46-991f-98d34c9b3f4c-kube-api-access-vvc9p\") pod \"test-model-fa8ad7-kserve-77d775478c-4shmb\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") " pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:11.126393 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:11.126334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:11.257046 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:11.257003    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"]
Jul 23 18:40:11.513256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:11.513174    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb" event={"ID":"740222aa-3f7b-4d46-991f-98d34c9b3f4c","Type":"ContainerStarted","Data":"ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4"}
Jul 23 18:40:11.513256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:11.513217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb" event={"ID":"740222aa-3f7b-4d46-991f-98d34c9b3f4c","Type":"ContainerStarted","Data":"9debacf697ebe5d1a195f609bcff781204d58a73a41ddadc764cf8c74313bc66"}
Jul 23 18:40:11.539859 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:11.539817    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb" podStartSLOduration=1.5398026360000001 podStartE2EDuration="1.539802636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:11.538111399 +0000 UTC m=+2273.950814197" watchObservedRunningTime="2026-07-23 18:40:11.539802636 +0000 UTC m=+2273.952505434"
Jul 23 18:40:21.126484 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:21.126451    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:21.126959 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:21.126498    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:21.138718 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:21.138695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:21.571624 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:21.571594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:40:54.483835 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:54.483795    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"]
Jul 23 18:40:55.438834 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:40:55.438800    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"]
Jul 23 18:41:09.504031 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.503964    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq" podUID="d150b80f-42fd-4aa2-8f11-5312eb912034" containerName="main" containerID="cri-o://10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c" gracePeriod=45
Jul 23 18:41:09.761883 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.761815    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:41:09.795126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.795094    2578 generic.go:356] "Generic (PLEG): container finished" podID="d150b80f-42fd-4aa2-8f11-5312eb912034" containerID="10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c" exitCode=0
Jul 23 18:41:09.795301 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.795143    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"
Jul 23 18:41:09.795301 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.795178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq" event={"ID":"d150b80f-42fd-4aa2-8f11-5312eb912034","Type":"ContainerDied","Data":"10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c"}
Jul 23 18:41:09.795301 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.795223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq" event={"ID":"d150b80f-42fd-4aa2-8f11-5312eb912034","Type":"ContainerDied","Data":"45d47d6654f1d67b1bf66c1f51c4afd256bb1c1a79a01e42ad4a0b8393e648a6"}
Jul 23 18:41:09.795301 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.795245    2578 scope.go:117] "RemoveContainer" containerID="10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c"
Jul 23 18:41:09.804198 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.804168    2578 scope.go:117] "RemoveContainer" containerID="10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c"
Jul 23 18:41:09.804450 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:41:09.804429    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c\": container with ID starting with 10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c not found: ID does not exist" containerID="10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c"
Jul 23 18:41:09.804540 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.804458    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c"} err="failed to get container status \"10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c\": rpc error: code = NotFound desc = could not find container \"10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c\": container with ID starting with 10f102766cca86343cc5fd82fe30452af19fa345b6359cd02a96f512df03d10c not found: ID does not exist"
Jul 23 18:41:09.867101 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-tmp-dir\") pod \"d150b80f-42fd-4aa2-8f11-5312eb912034\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") "
Jul 23 18:41:09.867202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-model-cache\") pod \"d150b80f-42fd-4aa2-8f11-5312eb912034\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") "
Jul 23 18:41:09.867202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867165    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-home\") pod \"d150b80f-42fd-4aa2-8f11-5312eb912034\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") "
Jul 23 18:41:09.867202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7ndp\" (UniqueName: \"kubernetes.io/projected/d150b80f-42fd-4aa2-8f11-5312eb912034-kube-api-access-x7ndp\") pod \"d150b80f-42fd-4aa2-8f11-5312eb912034\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") "
Jul 23 18:41:09.867336 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d150b80f-42fd-4aa2-8f11-5312eb912034-tls-certs\") pod \"d150b80f-42fd-4aa2-8f11-5312eb912034\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") "
Jul 23 18:41:09.867336 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-dshm\") pod \"d150b80f-42fd-4aa2-8f11-5312eb912034\" (UID: \"d150b80f-42fd-4aa2-8f11-5312eb912034\") "
Jul 23 18:41:09.867336 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867291    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d150b80f-42fd-4aa2-8f11-5312eb912034" (UID: "d150b80f-42fd-4aa2-8f11-5312eb912034"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:09.867528 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-model-cache" (OuterVolumeSpecName: "model-cache") pod "d150b80f-42fd-4aa2-8f11-5312eb912034" (UID: "d150b80f-42fd-4aa2-8f11-5312eb912034"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:09.867528 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-home" (OuterVolumeSpecName: "home") pod "d150b80f-42fd-4aa2-8f11-5312eb912034" (UID: "d150b80f-42fd-4aa2-8f11-5312eb912034"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:09.867671 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867553    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:09.867671 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867574    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:09.867671 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.867586    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:09.869472 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.869450    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-dshm" (OuterVolumeSpecName: "dshm") pod "d150b80f-42fd-4aa2-8f11-5312eb912034" (UID: "d150b80f-42fd-4aa2-8f11-5312eb912034"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:09.869472 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.869462    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d150b80f-42fd-4aa2-8f11-5312eb912034-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d150b80f-42fd-4aa2-8f11-5312eb912034" (UID: "d150b80f-42fd-4aa2-8f11-5312eb912034"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:41:09.869579 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.869520    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d150b80f-42fd-4aa2-8f11-5312eb912034-kube-api-access-x7ndp" (OuterVolumeSpecName: "kube-api-access-x7ndp") pod "d150b80f-42fd-4aa2-8f11-5312eb912034" (UID: "d150b80f-42fd-4aa2-8f11-5312eb912034"). InnerVolumeSpecName "kube-api-access-x7ndp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:41:09.968741 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.968718    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7ndp\" (UniqueName: \"kubernetes.io/projected/d150b80f-42fd-4aa2-8f11-5312eb912034-kube-api-access-x7ndp\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:09.968741 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.968742    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d150b80f-42fd-4aa2-8f11-5312eb912034-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:09.968892 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:09.968753    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d150b80f-42fd-4aa2-8f11-5312eb912034-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:10.122152 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.122129    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"]
Jul 23 18:41:10.128794 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.128771    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-89c000/test-model-89c000-kserve-55dd877cd9-cmpjq"]
Jul 23 18:41:10.459606 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.459523    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb" podUID="740222aa-3f7b-4d46-991f-98d34c9b3f4c" containerName="main" containerID="cri-o://ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4" gracePeriod=45
Jul 23 18:41:10.710280 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.710225    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:41:10.774932 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.774906    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-dshm\") pod \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") "
Jul 23 18:41:10.774932 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.774935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvc9p\" (UniqueName: \"kubernetes.io/projected/740222aa-3f7b-4d46-991f-98d34c9b3f4c-kube-api-access-vvc9p\") pod \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") "
Jul 23 18:41:10.775146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.774989    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-home\") pod \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") "
Jul 23 18:41:10.775146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tmp-dir\") pod \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") "
Jul 23 18:41:10.775146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-model-cache\") pod \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") "
Jul 23 18:41:10.775146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tls-certs\") pod \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\" (UID: \"740222aa-3f7b-4d46-991f-98d34c9b3f4c\") "
Jul 23 18:41:10.775475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "740222aa-3f7b-4d46-991f-98d34c9b3f4c" (UID: "740222aa-3f7b-4d46-991f-98d34c9b3f4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:10.775475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775273    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-home" (OuterVolumeSpecName: "home") pod "740222aa-3f7b-4d46-991f-98d34c9b3f4c" (UID: "740222aa-3f7b-4d46-991f-98d34c9b3f4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:10.775475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "740222aa-3f7b-4d46-991f-98d34c9b3f4c" (UID: "740222aa-3f7b-4d46-991f-98d34c9b3f4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:10.775475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775394    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:10.775475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775433    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:10.775475 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.775445    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:10.777227 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.777203    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "740222aa-3f7b-4d46-991f-98d34c9b3f4c" (UID: "740222aa-3f7b-4d46-991f-98d34c9b3f4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:41:10.777318 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.777202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-dshm" (OuterVolumeSpecName: "dshm") pod "740222aa-3f7b-4d46-991f-98d34c9b3f4c" (UID: "740222aa-3f7b-4d46-991f-98d34c9b3f4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:10.777318 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.777244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/740222aa-3f7b-4d46-991f-98d34c9b3f4c-kube-api-access-vvc9p" (OuterVolumeSpecName: "kube-api-access-vvc9p") pod "740222aa-3f7b-4d46-991f-98d34c9b3f4c" (UID: "740222aa-3f7b-4d46-991f-98d34c9b3f4c"). InnerVolumeSpecName "kube-api-access-vvc9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:41:10.804155 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.804130    2578 generic.go:356] "Generic (PLEG): container finished" podID="740222aa-3f7b-4d46-991f-98d34c9b3f4c" containerID="ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4" exitCode=0
Jul 23 18:41:10.804262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.804177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"
Jul 23 18:41:10.804262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.804214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb" event={"ID":"740222aa-3f7b-4d46-991f-98d34c9b3f4c","Type":"ContainerDied","Data":"ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4"}
Jul 23 18:41:10.804262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.804254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb" event={"ID":"740222aa-3f7b-4d46-991f-98d34c9b3f4c","Type":"ContainerDied","Data":"9debacf697ebe5d1a195f609bcff781204d58a73a41ddadc764cf8c74313bc66"}
Jul 23 18:41:10.804379 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.804272    2578 scope.go:117] "RemoveContainer" containerID="ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4"
Jul 23 18:41:10.813051 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.813029    2578 scope.go:117] "RemoveContainer" containerID="ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4"
Jul 23 18:41:10.813304 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:41:10.813285    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4\": container with ID starting with ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4 not found: ID does not exist" containerID="ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4"
Jul 23 18:41:10.813358 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.813313    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4"} err="failed to get container status \"ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4\": rpc error: code = NotFound desc = could not find container \"ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4\": container with ID starting with ca7a233e1acc2e5173c45ae05d044a67e1262f96a4bf7bd4a27c274160a2a2b4 not found: ID does not exist"
Jul 23 18:41:10.827494 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.827470    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"]
Jul 23 18:41:10.831981 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.831963    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fa8ad7/test-model-fa8ad7-kserve-77d775478c-4shmb"]
Jul 23 18:41:10.876586 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.876565    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/740222aa-3f7b-4d46-991f-98d34c9b3f4c-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:10.876586 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.876583    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/740222aa-3f7b-4d46-991f-98d34c9b3f4c-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:10.876703 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:10.876592    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvc9p\" (UniqueName: \"kubernetes.io/projected/740222aa-3f7b-4d46-991f-98d34c9b3f4c-kube-api-access-vvc9p\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:41:12.121901 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:12.121869    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="740222aa-3f7b-4d46-991f-98d34c9b3f4c" path="/var/lib/kubelet/pods/740222aa-3f7b-4d46-991f-98d34c9b3f4c/volumes"
Jul 23 18:41:12.122255 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:41:12.122224    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d150b80f-42fd-4aa2-8f11-5312eb912034" path="/var/lib/kubelet/pods/d150b80f-42fd-4aa2-8f11-5312eb912034/volumes"
Jul 23 18:43:45.317684 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.317653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"]
Jul 23 18:43:45.318077 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.318022    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="740222aa-3f7b-4d46-991f-98d34c9b3f4c" containerName="main"
Jul 23 18:43:45.318077 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.318032    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="740222aa-3f7b-4d46-991f-98d34c9b3f4c" containerName="main"
Jul 23 18:43:45.318077 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.318048    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d150b80f-42fd-4aa2-8f11-5312eb912034" containerName="main"
Jul 23 18:43:45.318077 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.318054    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d150b80f-42fd-4aa2-8f11-5312eb912034" containerName="main"
Jul 23 18:43:45.318207 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.318117    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="740222aa-3f7b-4d46-991f-98d34c9b3f4c" containerName="main"
Jul 23 18:43:45.318207 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.318125    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d150b80f-42fd-4aa2-8f11-5312eb912034" containerName="main"
Jul 23 18:43:45.320998 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.320982    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.324627 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.324606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"openshift-service-ca.crt\""
Jul 23 18:43:45.324835 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.324814    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"auth-test-model-d87a73-kserve-self-signed-certs\""
Jul 23 18:43:45.324915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.324817    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"default-dockercfg-j7wbl\""
Jul 23 18:43:45.324915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.324820    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"kube-root-ca.crt\""
Jul 23 18:43:45.330347 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.330325    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"]
Jul 23 18:43:45.364775 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.364738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db50cfce-911f-423e-ad2b-d3ba0d598df2-tls-certs\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.364924 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.364796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-dshm\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.364924 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.364824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdh4g\" (UniqueName: \"kubernetes.io/projected/db50cfce-911f-423e-ad2b-d3ba0d598df2-kube-api-access-wdh4g\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.364924 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.364883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-tmp-dir\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.365038 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.364932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-model-cache\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.365038 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.364966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-home\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.465884 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.465842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db50cfce-911f-423e-ad2b-d3ba0d598df2-tls-certs\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.465884 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.465892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-dshm\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466106 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.465912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh4g\" (UniqueName: \"kubernetes.io/projected/db50cfce-911f-423e-ad2b-d3ba0d598df2-kube-api-access-wdh4g\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466106 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.465952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-tmp-dir\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466106 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.465972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-model-cache\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466106 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.465995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-home\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466424 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.466379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-tmp-dir\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466542 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.466445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-home\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.466542 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.466475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-model-cache\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.468082 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.468056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-dshm\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.468492 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.468473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db50cfce-911f-423e-ad2b-d3ba0d598df2-tls-certs\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.476606 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.476588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdh4g\" (UniqueName: \"kubernetes.io/projected/db50cfce-911f-423e-ad2b-d3ba0d598df2-kube-api-access-wdh4g\") pod \"auth-test-model-d87a73-kserve-788696df87-7tw6c\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") " pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.631353 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.631295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:45.761459 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:45.761432    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"]
Jul 23 18:43:45.763641 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:43:45.763614    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb50cfce_911f_423e_ad2b_d3ba0d598df2.slice/crio-fa6034fd61d7d767960ba170b8029a7b5e52d337968712f2b50411f4faa5f2eb WatchSource:0}: Error finding container fa6034fd61d7d767960ba170b8029a7b5e52d337968712f2b50411f4faa5f2eb: Status 404 returned error can't find the container with id fa6034fd61d7d767960ba170b8029a7b5e52d337968712f2b50411f4faa5f2eb
Jul 23 18:43:46.534208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:46.534171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c" event={"ID":"db50cfce-911f-423e-ad2b-d3ba0d598df2","Type":"ContainerStarted","Data":"5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f"}
Jul 23 18:43:46.534208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:46.534214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c" event={"ID":"db50cfce-911f-423e-ad2b-d3ba0d598df2","Type":"ContainerStarted","Data":"fa6034fd61d7d767960ba170b8029a7b5e52d337968712f2b50411f4faa5f2eb"}
Jul 23 18:43:46.555588 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:46.555545    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c" podStartSLOduration=1.5555320849999998 podStartE2EDuration="1.555532085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:46.553645278 +0000 UTC m=+2488.966348076" watchObservedRunningTime="2026-07-23 18:43:46.555532085 +0000 UTC m=+2488.968234908"
Jul 23 18:43:55.632183 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:55.632152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:55.632576 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:55.632195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:55.644420 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:55.644384    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:43:56.597794 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:43:56.597771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:44:18.336876 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.336846    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"]
Jul 23 18:44:18.340013 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.339997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.343753 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.343727    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"openshift-service-ca.crt\""
Jul 23 18:44:18.344596 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.344573    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"kube-root-ca.crt\""
Jul 23 18:44:18.345017 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.344997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"auth-test-model-118a8c-kserve-self-signed-certs\""
Jul 23 18:44:18.345468 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.345450    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"default-dockercfg-g4bc5\""
Jul 23 18:44:18.352523 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.352113    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"]
Jul 23 18:44:18.432841 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.432818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-model-cache\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.432963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.432849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9qvz\" (UniqueName: \"kubernetes.io/projected/0985e50c-9dbf-4753-892a-d663d7a6bf8b-kube-api-access-f9qvz\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.432963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.432868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tmp-dir\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.432963 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.432886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-home\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.433101 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.433083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-dshm\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.433140 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.433117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tls-certs\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534375 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-dshm\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tls-certs\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-model-cache\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534518 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9qvz\" (UniqueName: \"kubernetes.io/projected/0985e50c-9dbf-4753-892a-d663d7a6bf8b-kube-api-access-f9qvz\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534677 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tmp-dir\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534677 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-home\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534857 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-model-cache\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534916 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tmp-dir\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.534916 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.534904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-home\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.536658 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.536637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-dshm\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.536915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.536897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tls-certs\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.544898 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.544878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9qvz\" (UniqueName: \"kubernetes.io/projected/0985e50c-9dbf-4753-892a-d663d7a6bf8b-kube-api-access-f9qvz\") pod \"auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") " pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.655659 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.655606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:18.797866 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:18.797837    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"]
Jul 23 18:44:18.800257 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:44:18.800232    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0985e50c_9dbf_4753_892a_d663d7a6bf8b.slice/crio-1b7896ebcb04add4d3504b939e1ddc4567b437086246bf6d1fe41cbb34a1e67e WatchSource:0}: Error finding container 1b7896ebcb04add4d3504b939e1ddc4567b437086246bf6d1fe41cbb34a1e67e: Status 404 returned error can't find the container with id 1b7896ebcb04add4d3504b939e1ddc4567b437086246bf6d1fe41cbb34a1e67e
Jul 23 18:44:19.695892 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:19.695864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x" event={"ID":"0985e50c-9dbf-4753-892a-d663d7a6bf8b","Type":"ContainerStarted","Data":"b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df"}
Jul 23 18:44:19.696256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:19.695906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x" event={"ID":"0985e50c-9dbf-4753-892a-d663d7a6bf8b","Type":"ContainerStarted","Data":"1b7896ebcb04add4d3504b939e1ddc4567b437086246bf6d1fe41cbb34a1e67e"}
Jul 23 18:44:19.717623 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:19.717572    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x" podStartSLOduration=1.717557769 podStartE2EDuration="1.717557769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:19.716718844 +0000 UTC m=+2522.129421632" watchObservedRunningTime="2026-07-23 18:44:19.717557769 +0000 UTC m=+2522.130260556"
Jul 23 18:44:28.656068 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:28.656035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:28.656547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:28.656083    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:28.667989 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:28.667968    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:44:28.747997 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:44:28.747962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:46:32.458486 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:32.458452    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"]
Jul 23 18:46:33.361613 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:33.361581    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"]
Jul 23 18:46:42.818430 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.818384    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"]
Jul 23 18:46:42.821882 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.821864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.827785 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.827755    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"sub-test-model-d87a73-kserve-self-signed-certs\""
Jul 23 18:46:42.833145 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.833117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"]
Jul 23 18:46:42.873124 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.873100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tmp-dir\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.873225 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.873143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-dshm\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.873225 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.873162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrdx\" (UniqueName: \"kubernetes.io/projected/2b3511c4-f321-46b0-9f00-0568cbfb97f6-kube-api-access-fvrdx\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.873307 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.873242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-home\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.873307 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.873283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tls-certs\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.873371 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.873339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-model-cache\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.973917 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.973891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tmp-dir\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974022 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.973935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-dshm\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974022 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.973952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrdx\" (UniqueName: \"kubernetes.io/projected/2b3511c4-f321-46b0-9f00-0568cbfb97f6-kube-api-access-fvrdx\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974022 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.973981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-home\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974022 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.974010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tls-certs\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974209 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.974054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-model-cache\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974372 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.974351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tmp-dir\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.974437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-home\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.974473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.974454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-model-cache\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.976064 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.976050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-dshm\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.976604 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.976584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tls-certs\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:42.985133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:42.985109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrdx\" (UniqueName: \"kubernetes.io/projected/2b3511c4-f321-46b0-9f00-0568cbfb97f6-kube-api-access-fvrdx\") pod \"sub-test-model-d87a73-kserve-675c65cd7f-9x9xn\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") " pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:43.131049 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:43.130993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:43.262547 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:43.262523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"]
Jul 23 18:46:43.264452 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:46:43.264431    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b3511c4_f321_46b0_9f00_0568cbfb97f6.slice/crio-368274b4847680229bc41a4456e4dae2f2a8e8d5d538d43fbf1750ba21f5ee28 WatchSource:0}: Error finding container 368274b4847680229bc41a4456e4dae2f2a8e8d5d538d43fbf1750ba21f5ee28: Status 404 returned error can't find the container with id 368274b4847680229bc41a4456e4dae2f2a8e8d5d538d43fbf1750ba21f5ee28
Jul 23 18:46:43.374728 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:43.374693    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn" event={"ID":"2b3511c4-f321-46b0-9f00-0568cbfb97f6","Type":"ContainerStarted","Data":"e21a74d0a3d2cbfc915eb507ba029b0120ce684c3b90ec5f9ee3fdc4043bb56c"}
Jul 23 18:46:43.374865 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:43.374740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn" event={"ID":"2b3511c4-f321-46b0-9f00-0568cbfb97f6","Type":"ContainerStarted","Data":"368274b4847680229bc41a4456e4dae2f2a8e8d5d538d43fbf1750ba21f5ee28"}
Jul 23 18:46:43.395308 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:43.395221    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn" podStartSLOduration=1.395206036 podStartE2EDuration="1.395206036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:43.393882812 +0000 UTC m=+2665.806585600" watchObservedRunningTime="2026-07-23 18:46:43.395206036 +0000 UTC m=+2665.807908824"
Jul 23 18:46:47.478070 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.478013    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c" podUID="db50cfce-911f-423e-ad2b-d3ba0d598df2" containerName="main" containerID="cri-o://5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f" gracePeriod=45
Jul 23 18:46:47.733163 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.733105    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:46:47.817682 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-home\") pod \"db50cfce-911f-423e-ad2b-d3ba0d598df2\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") "
Jul 23 18:46:47.817821 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-tmp-dir\") pod \"db50cfce-911f-423e-ad2b-d3ba0d598df2\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") "
Jul 23 18:46:47.817821 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817744    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdh4g\" (UniqueName: \"kubernetes.io/projected/db50cfce-911f-423e-ad2b-d3ba0d598df2-kube-api-access-wdh4g\") pod \"db50cfce-911f-423e-ad2b-d3ba0d598df2\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") "
Jul 23 18:46:47.817821 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817774    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-dshm\") pod \"db50cfce-911f-423e-ad2b-d3ba0d598df2\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") "
Jul 23 18:46:47.817821 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817794    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-model-cache\") pod \"db50cfce-911f-423e-ad2b-d3ba0d598df2\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") "
Jul 23 18:46:47.818026 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db50cfce-911f-423e-ad2b-d3ba0d598df2-tls-certs\") pod \"db50cfce-911f-423e-ad2b-d3ba0d598df2\" (UID: \"db50cfce-911f-423e-ad2b-d3ba0d598df2\") "
Jul 23 18:46:47.818026 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.817947    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-home" (OuterVolumeSpecName: "home") pod "db50cfce-911f-423e-ad2b-d3ba0d598df2" (UID: "db50cfce-911f-423e-ad2b-d3ba0d598df2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:47.818126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.818046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db50cfce-911f-423e-ad2b-d3ba0d598df2" (UID: "db50cfce-911f-423e-ad2b-d3ba0d598df2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:47.818126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.818058    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-model-cache" (OuterVolumeSpecName: "model-cache") pod "db50cfce-911f-423e-ad2b-d3ba0d598df2" (UID: "db50cfce-911f-423e-ad2b-d3ba0d598df2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:47.818250 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.818231    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:47.818295 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.818255    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:47.818295 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.818272    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:47.819991 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.819969    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-dshm" (OuterVolumeSpecName: "dshm") pod "db50cfce-911f-423e-ad2b-d3ba0d598df2" (UID: "db50cfce-911f-423e-ad2b-d3ba0d598df2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:47.819991 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.819980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db50cfce-911f-423e-ad2b-d3ba0d598df2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db50cfce-911f-423e-ad2b-d3ba0d598df2" (UID: "db50cfce-911f-423e-ad2b-d3ba0d598df2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:46:47.820147 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.820039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db50cfce-911f-423e-ad2b-d3ba0d598df2-kube-api-access-wdh4g" (OuterVolumeSpecName: "kube-api-access-wdh4g") pod "db50cfce-911f-423e-ad2b-d3ba0d598df2" (UID: "db50cfce-911f-423e-ad2b-d3ba0d598df2"). InnerVolumeSpecName "kube-api-access-wdh4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:46:47.919538 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.919515    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db50cfce-911f-423e-ad2b-d3ba0d598df2-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:47.919538 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.919535    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db50cfce-911f-423e-ad2b-d3ba0d598df2-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:47.919653 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:47.919544    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdh4g\" (UniqueName: \"kubernetes.io/projected/db50cfce-911f-423e-ad2b-d3ba0d598df2-kube-api-access-wdh4g\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:48.381262 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.381170    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x" podUID="0985e50c-9dbf-4753-892a-d663d7a6bf8b" containerName="main" containerID="cri-o://b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df" gracePeriod=45
Jul 23 18:46:48.399071 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.399045    2578 generic.go:356] "Generic (PLEG): container finished" podID="db50cfce-911f-423e-ad2b-d3ba0d598df2" containerID="5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f" exitCode=0
Jul 23 18:46:48.399187 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.399083    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"
Jul 23 18:46:48.399187 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.399133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c" event={"ID":"db50cfce-911f-423e-ad2b-d3ba0d598df2","Type":"ContainerDied","Data":"5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f"}
Jul 23 18:46:48.399187 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.399172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c" event={"ID":"db50cfce-911f-423e-ad2b-d3ba0d598df2","Type":"ContainerDied","Data":"fa6034fd61d7d767960ba170b8029a7b5e52d337968712f2b50411f4faa5f2eb"}
Jul 23 18:46:48.399314 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.399190    2578 scope.go:117] "RemoveContainer" containerID="5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f"
Jul 23 18:46:48.458646 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.458621    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"]
Jul 23 18:46:48.463760 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.463739    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/auth-test-model-d87a73-kserve-788696df87-7tw6c"]
Jul 23 18:46:48.496822 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.496801    2578 scope.go:117] "RemoveContainer" containerID="5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f"
Jul 23 18:46:48.497112 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:46:48.497092    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f\": container with ID starting with 5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f not found: ID does not exist" containerID="5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f"
Jul 23 18:46:48.497158 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.497123    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f"} err="failed to get container status \"5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f\": rpc error: code = NotFound desc = could not find container \"5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f\": container with ID starting with 5954a7e3d400537f9ed09f4adb5aaa773e4730e8d10b107549fe3e87cad8954f not found: ID does not exist"
Jul 23 18:46:48.622104 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.622083    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:46:48.727574 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-model-cache\") pod \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") "
Jul 23 18:46:48.727574 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727569    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tls-certs\") pod \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") "
Jul 23 18:46:48.727765 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tmp-dir\") pod \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") "
Jul 23 18:46:48.727765 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9qvz\" (UniqueName: \"kubernetes.io/projected/0985e50c-9dbf-4753-892a-d663d7a6bf8b-kube-api-access-f9qvz\") pod \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") "
Jul 23 18:46:48.727765 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727677    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-home\") pod \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") "
Jul 23 18:46:48.727765 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727701    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0985e50c-9dbf-4753-892a-d663d7a6bf8b" (UID: "0985e50c-9dbf-4753-892a-d663d7a6bf8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:48.727765 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-dshm\") pod \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\" (UID: \"0985e50c-9dbf-4753-892a-d663d7a6bf8b\") "
Jul 23 18:46:48.728025 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727861    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0985e50c-9dbf-4753-892a-d663d7a6bf8b" (UID: "0985e50c-9dbf-4753-892a-d663d7a6bf8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:48.728025 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.727946    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-home" (OuterVolumeSpecName: "home") pod "0985e50c-9dbf-4753-892a-d663d7a6bf8b" (UID: "0985e50c-9dbf-4753-892a-d663d7a6bf8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:48.728126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.728074    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:48.728126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.728094    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:48.728126 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.728111    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:48.729782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.729755    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-dshm" (OuterVolumeSpecName: "dshm") pod "0985e50c-9dbf-4753-892a-d663d7a6bf8b" (UID: "0985e50c-9dbf-4753-892a-d663d7a6bf8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:48.729885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.729802    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0985e50c-9dbf-4753-892a-d663d7a6bf8b-kube-api-access-f9qvz" (OuterVolumeSpecName: "kube-api-access-f9qvz") pod "0985e50c-9dbf-4753-892a-d663d7a6bf8b" (UID: "0985e50c-9dbf-4753-892a-d663d7a6bf8b"). InnerVolumeSpecName "kube-api-access-f9qvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:46:48.729885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.729812    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0985e50c-9dbf-4753-892a-d663d7a6bf8b" (UID: "0985e50c-9dbf-4753-892a-d663d7a6bf8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:46:48.828580 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.828554    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985e50c-9dbf-4753-892a-d663d7a6bf8b-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:48.828580 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.828576    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9qvz\" (UniqueName: \"kubernetes.io/projected/0985e50c-9dbf-4753-892a-d663d7a6bf8b-kube-api-access-f9qvz\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:48.828737 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:48.828585    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985e50c-9dbf-4753-892a-d663d7a6bf8b-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:46:49.405348 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.405313    2578 generic.go:356] "Generic (PLEG): container finished" podID="0985e50c-9dbf-4753-892a-d663d7a6bf8b" containerID="b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df" exitCode=0
Jul 23 18:46:49.405348 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.405351    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"
Jul 23 18:46:49.405619 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.405388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x" event={"ID":"0985e50c-9dbf-4753-892a-d663d7a6bf8b","Type":"ContainerDied","Data":"b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df"}
Jul 23 18:46:49.405619 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.405452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x" event={"ID":"0985e50c-9dbf-4753-892a-d663d7a6bf8b","Type":"ContainerDied","Data":"1b7896ebcb04add4d3504b939e1ddc4567b437086246bf6d1fe41cbb34a1e67e"}
Jul 23 18:46:49.405619 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.405475    2578 scope.go:117] "RemoveContainer" containerID="b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df"
Jul 23 18:46:49.414459 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.414443    2578 scope.go:117] "RemoveContainer" containerID="b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df"
Jul 23 18:46:49.414717 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:46:49.414701    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df\": container with ID starting with b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df not found: ID does not exist" containerID="b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df"
Jul 23 18:46:49.414767 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.414725    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df"} err="failed to get container status \"b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df\": rpc error: code = NotFound desc = could not find container \"b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df\": container with ID starting with b0fc8c82e08ed04365dc974db6aa53740ed26d55b68d6a703a5bf1a9e01b21df not found: ID does not exist"
Jul 23 18:46:49.429038 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.429014    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"]
Jul 23 18:46:49.439026 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:49.435577    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/auth-test-model-118a8c-kserve-5f9dcbccc5-6wp7x"]
Jul 23 18:46:50.124497 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:50.124468    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0985e50c-9dbf-4753-892a-d663d7a6bf8b" path="/var/lib/kubelet/pods/0985e50c-9dbf-4753-892a-d663d7a6bf8b/volumes"
Jul 23 18:46:50.124895 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:50.124881    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db50cfce-911f-423e-ad2b-d3ba0d598df2" path="/var/lib/kubelet/pods/db50cfce-911f-423e-ad2b-d3ba0d598df2/volumes"
Jul 23 18:46:53.131255 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:53.131228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:53.131775 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:53.131288    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:53.143492 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:53.143466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:46:53.438221 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:46:53.438148    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:47:22.007552 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.007519    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"]
Jul 23 18:47:22.008062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.007905    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0985e50c-9dbf-4753-892a-d663d7a6bf8b" containerName="main"
Jul 23 18:47:22.008062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.007916    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0985e50c-9dbf-4753-892a-d663d7a6bf8b" containerName="main"
Jul 23 18:47:22.008062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.007928    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db50cfce-911f-423e-ad2b-d3ba0d598df2" containerName="main"
Jul 23 18:47:22.008062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.007933    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db50cfce-911f-423e-ad2b-d3ba0d598df2" containerName="main"
Jul 23 18:47:22.008062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.007995    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0985e50c-9dbf-4753-892a-d663d7a6bf8b" containerName="main"
Jul 23 18:47:22.008062 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.008008    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db50cfce-911f-423e-ad2b-d3ba0d598df2" containerName="main"
Jul 23 18:47:22.012451 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.012429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.015202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.015180    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"openshift-service-ca.crt\""
Jul 23 18:47:22.015333 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.015227    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"kube-root-ca.crt\""
Jul 23 18:47:22.016450 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.016428    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"sub-test-model-118a8c-kserve-self-signed-certs\""
Jul 23 18:47:22.016610 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.016596    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"default-dockercfg-g4bc5\""
Jul 23 18:47:22.021202 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.021180    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"]
Jul 23 18:47:22.023377 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.023356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tmp-dir\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.023508 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.023390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-model-cache\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.023508 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.023434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tls-certs\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.023508 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.023501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2gk\" (UniqueName: \"kubernetes.io/projected/17fbaf8e-76b3-4e27-b34a-796d35b2930a-kube-api-access-kk2gk\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.023677 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.023532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-home\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.023677 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.023567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-dshm\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124081 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-dshm\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tmp-dir\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-model-cache\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tls-certs\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2gk\" (UniqueName: \"kubernetes.io/projected/17fbaf8e-76b3-4e27-b34a-796d35b2930a-kube-api-access-kk2gk\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124268 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-home\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124586 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tmp-dir\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124635 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-model-cache\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.124635 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.124618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-home\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.126335 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.126313    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-dshm\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.126617 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.126600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tls-certs\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.133830 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.133807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2gk\" (UniqueName: \"kubernetes.io/projected/17fbaf8e-76b3-4e27-b34a-796d35b2930a-kube-api-access-kk2gk\") pod \"sub-test-model-118a8c-kserve-69db776f55-5zwgl\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") " pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.322666 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.322634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:22.464637 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.464609    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"]
Jul 23 18:47:22.465360 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:47:22.465340    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17fbaf8e_76b3_4e27_b34a_796d35b2930a.slice/crio-953fda18dfc59d01446a3164ce34c0d5d02c8e5472524b017112a3f7daaeb336 WatchSource:0}: Error finding container 953fda18dfc59d01446a3164ce34c0d5d02c8e5472524b017112a3f7daaeb336: Status 404 returned error can't find the container with id 953fda18dfc59d01446a3164ce34c0d5d02c8e5472524b017112a3f7daaeb336
Jul 23 18:47:22.563085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.563043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl" event={"ID":"17fbaf8e-76b3-4e27-b34a-796d35b2930a","Type":"ContainerStarted","Data":"957021a4a7b25cc51cc00e591845665487d5c8e380d84229c0ea85318fdc81c7"}
Jul 23 18:47:22.563085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.563085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl" event={"ID":"17fbaf8e-76b3-4e27-b34a-796d35b2930a","Type":"ContainerStarted","Data":"953fda18dfc59d01446a3164ce34c0d5d02c8e5472524b017112a3f7daaeb336"}
Jul 23 18:47:22.584786 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:22.584678    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl" podStartSLOduration=1.584663261 podStartE2EDuration="1.584663261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:47:22.582676382 +0000 UTC m=+2704.995379171" watchObservedRunningTime="2026-07-23 18:47:22.584663261 +0000 UTC m=+2704.997366050"
Jul 23 18:47:32.323103 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:32.323069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:32.323573 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:32.323118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:32.335555 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:32.335532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:47:32.619780 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:47:32.619710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:48:08.681515 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:08.681478    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"]
Jul 23 18:48:09.688640 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:09.688606    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"]
Jul 23 18:48:23.700702 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.700656    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn" podUID="2b3511c4-f321-46b0-9f00-0568cbfb97f6" containerName="main" containerID="cri-o://e21a74d0a3d2cbfc915eb507ba029b0120ce684c3b90ec5f9ee3fdc4043bb56c" gracePeriod=45
Jul 23 18:48:23.867458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.867424    2578 generic.go:356] "Generic (PLEG): container finished" podID="2b3511c4-f321-46b0-9f00-0568cbfb97f6" containerID="e21a74d0a3d2cbfc915eb507ba029b0120ce684c3b90ec5f9ee3fdc4043bb56c" exitCode=0
Jul 23 18:48:23.867458 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.867446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn" event={"ID":"2b3511c4-f321-46b0-9f00-0568cbfb97f6","Type":"ContainerDied","Data":"e21a74d0a3d2cbfc915eb507ba029b0120ce684c3b90ec5f9ee3fdc4043bb56c"}
Jul 23 18:48:23.951089 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.951032    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:48:23.998036 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-home\") pod \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") "
Jul 23 18:48:23.998176 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998053    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tmp-dir\") pod \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") "
Jul 23 18:48:23.998176 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tls-certs\") pod \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") "
Jul 23 18:48:23.998176 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998143    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-dshm\") pod \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") "
Jul 23 18:48:23.998336 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-home" (OuterVolumeSpecName: "home") pod "2b3511c4-f321-46b0-9f00-0568cbfb97f6" (UID: "2b3511c4-f321-46b0-9f00-0568cbfb97f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:23.998393 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998363    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvrdx\" (UniqueName: \"kubernetes.io/projected/2b3511c4-f321-46b0-9f00-0568cbfb97f6-kube-api-access-fvrdx\") pod \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") "
Jul 23 18:48:23.998487 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998447    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-model-cache\") pod \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\" (UID: \"2b3511c4-f321-46b0-9f00-0568cbfb97f6\") "
Jul 23 18:48:23.998487 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998368    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b3511c4-f321-46b0-9f00-0568cbfb97f6" (UID: "2b3511c4-f321-46b0-9f00-0568cbfb97f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:23.998767 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998736    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b3511c4-f321-46b0-9f00-0568cbfb97f6" (UID: "2b3511c4-f321-46b0-9f00-0568cbfb97f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:23.998878 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998792    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:23.998878 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:23.998813    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:24.000279 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.000255    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b3511c4-f321-46b0-9f00-0568cbfb97f6" (UID: "2b3511c4-f321-46b0-9f00-0568cbfb97f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:48:24.000676 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.000653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-dshm" (OuterVolumeSpecName: "dshm") pod "2b3511c4-f321-46b0-9f00-0568cbfb97f6" (UID: "2b3511c4-f321-46b0-9f00-0568cbfb97f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:24.000744 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.000657    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3511c4-f321-46b0-9f00-0568cbfb97f6-kube-api-access-fvrdx" (OuterVolumeSpecName: "kube-api-access-fvrdx") pod "2b3511c4-f321-46b0-9f00-0568cbfb97f6" (UID: "2b3511c4-f321-46b0-9f00-0568cbfb97f6"). InnerVolumeSpecName "kube-api-access-fvrdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:48:24.099533 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.099512    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3511c4-f321-46b0-9f00-0568cbfb97f6-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:24.099533 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.099530    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:24.099650 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.099540    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvrdx\" (UniqueName: \"kubernetes.io/projected/2b3511c4-f321-46b0-9f00-0568cbfb97f6-kube-api-access-fvrdx\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:24.099650 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.099549    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3511c4-f321-46b0-9f00-0568cbfb97f6-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:24.708273 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.708238    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl" podUID="17fbaf8e-76b3-4e27-b34a-796d35b2930a" containerName="main" containerID="cri-o://957021a4a7b25cc51cc00e591845665487d5c8e380d84229c0ea85318fdc81c7" gracePeriod=45
Jul 23 18:48:24.873587 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.873554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"
Jul 23 18:48:24.873746 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.873583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn" event={"ID":"2b3511c4-f321-46b0-9f00-0568cbfb97f6","Type":"ContainerDied","Data":"368274b4847680229bc41a4456e4dae2f2a8e8d5d538d43fbf1750ba21f5ee28"}
Jul 23 18:48:24.873746 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.873633    2578 scope.go:117] "RemoveContainer" containerID="e21a74d0a3d2cbfc915eb507ba029b0120ce684c3b90ec5f9ee3fdc4043bb56c"
Jul 23 18:48:24.877114 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.877066    2578 generic.go:356] "Generic (PLEG): container finished" podID="17fbaf8e-76b3-4e27-b34a-796d35b2930a" containerID="957021a4a7b25cc51cc00e591845665487d5c8e380d84229c0ea85318fdc81c7" exitCode=0
Jul 23 18:48:24.877233 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.877106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl" event={"ID":"17fbaf8e-76b3-4e27-b34a-796d35b2930a","Type":"ContainerDied","Data":"957021a4a7b25cc51cc00e591845665487d5c8e380d84229c0ea85318fdc81c7"}
Jul 23 18:48:24.896964 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.896941    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"]
Jul 23 18:48:24.898765 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.898743    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/sub-test-model-d87a73-kserve-675c65cd7f-9x9xn"]
Jul 23 18:48:24.959513 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:24.959467    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:48:25.007504 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007481    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tls-certs\") pod \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") "
Jul 23 18:48:25.007644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-model-cache\") pod \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") "
Jul 23 18:48:25.007644 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007623    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk2gk\" (UniqueName: \"kubernetes.io/projected/17fbaf8e-76b3-4e27-b34a-796d35b2930a-kube-api-access-kk2gk\") pod \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") "
Jul 23 18:48:25.007757 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tmp-dir\") pod \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") "
Jul 23 18:48:25.007757 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-home\") pod \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") "
Jul 23 18:48:25.007865 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-dshm\") pod \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\" (UID: \"17fbaf8e-76b3-4e27-b34a-796d35b2930a\") "
Jul 23 18:48:25.007865 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.007806    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-model-cache" (OuterVolumeSpecName: "model-cache") pod "17fbaf8e-76b3-4e27-b34a-796d35b2930a" (UID: "17fbaf8e-76b3-4e27-b34a-796d35b2930a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:25.008046 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.008031    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:25.008107 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.008031    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-home" (OuterVolumeSpecName: "home") pod "17fbaf8e-76b3-4e27-b34a-796d35b2930a" (UID: "17fbaf8e-76b3-4e27-b34a-796d35b2930a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:25.008107 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.008039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "17fbaf8e-76b3-4e27-b34a-796d35b2930a" (UID: "17fbaf8e-76b3-4e27-b34a-796d35b2930a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:25.009620 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.009597    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "17fbaf8e-76b3-4e27-b34a-796d35b2930a" (UID: "17fbaf8e-76b3-4e27-b34a-796d35b2930a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:48:25.009885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.009867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-dshm" (OuterVolumeSpecName: "dshm") pod "17fbaf8e-76b3-4e27-b34a-796d35b2930a" (UID: "17fbaf8e-76b3-4e27-b34a-796d35b2930a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:25.010147 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.010127    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17fbaf8e-76b3-4e27-b34a-796d35b2930a-kube-api-access-kk2gk" (OuterVolumeSpecName: "kube-api-access-kk2gk") pod "17fbaf8e-76b3-4e27-b34a-796d35b2930a" (UID: "17fbaf8e-76b3-4e27-b34a-796d35b2930a"). InnerVolumeSpecName "kube-api-access-kk2gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:48:25.109120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.109096    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:25.109120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.109117    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:25.109241 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.109126    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:25.109241 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.109136    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk2gk\" (UniqueName: \"kubernetes.io/projected/17fbaf8e-76b3-4e27-b34a-796d35b2930a-kube-api-access-kk2gk\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:25.109241 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.109144    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17fbaf8e-76b3-4e27-b34a-796d35b2930a-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:48:25.531507 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531479    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"]
Jul 23 18:48:25.531850 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531830    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17fbaf8e-76b3-4e27-b34a-796d35b2930a" containerName="main"
Jul 23 18:48:25.531850 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531843    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="17fbaf8e-76b3-4e27-b34a-796d35b2930a" containerName="main"
Jul 23 18:48:25.531939 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531867    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3511c4-f321-46b0-9f00-0568cbfb97f6" containerName="main"
Jul 23 18:48:25.531939 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531873    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3511c4-f321-46b0-9f00-0568cbfb97f6" containerName="main"
Jul 23 18:48:25.531939 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531933    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="17fbaf8e-76b3-4e27-b34a-796d35b2930a" containerName="main"
Jul 23 18:48:25.532033 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.531945    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3511c4-f321-46b0-9f00-0568cbfb97f6" containerName="main"
Jul 23 18:48:25.534935 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.534914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.539582 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.539550    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"rate-test-model-d87a73-kserve-self-signed-certs\""
Jul 23 18:48:25.539706 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.539619    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"default-dockercfg-j7wbl\""
Jul 23 18:48:25.539706 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.539633    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"kube-root-ca.crt\""
Jul 23 18:48:25.539706 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.539671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d87a73\"/\"openshift-service-ca.crt\""
Jul 23 18:48:25.545535 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.545514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"]
Jul 23 18:48:25.612920 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.612895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-tmp-dir\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.613060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.612924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgcnr\" (UniqueName: \"kubernetes.io/projected/3d7def3e-5d6d-4d69-a70c-064cab180460-kube-api-access-jgcnr\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.613060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.612944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7def3e-5d6d-4d69-a70c-064cab180460-tls-certs\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.613060 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.613027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-model-cache\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.613175 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.613087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-home\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.613175 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.613116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-dshm\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714542 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-model-cache\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-home\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-dshm\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714666    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-tmp-dir\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgcnr\" (UniqueName: \"kubernetes.io/projected/3d7def3e-5d6d-4d69-a70c-064cab180460-kube-api-access-jgcnr\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7def3e-5d6d-4d69-a70c-064cab180460-tls-certs\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.714885 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-model-cache\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.715108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.714955    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-home\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.715108 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.715016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-tmp-dir\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.716844 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.716826    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-dshm\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.717105 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.717089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7def3e-5d6d-4d69-a70c-064cab180460-tls-certs\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.725562 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.725539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgcnr\" (UniqueName: \"kubernetes.io/projected/3d7def3e-5d6d-4d69-a70c-064cab180460-kube-api-access-jgcnr\") pod \"rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") " pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.843867 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.843790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:25.884566 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.884381    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"
Jul 23 18:48:25.884900 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.884766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl" event={"ID":"17fbaf8e-76b3-4e27-b34a-796d35b2930a","Type":"ContainerDied","Data":"953fda18dfc59d01446a3164ce34c0d5d02c8e5472524b017112a3f7daaeb336"}
Jul 23 18:48:25.884900 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.884822    2578 scope.go:117] "RemoveContainer" containerID="957021a4a7b25cc51cc00e591845665487d5c8e380d84229c0ea85318fdc81c7"
Jul 23 18:48:25.912097 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.912055    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"]
Jul 23 18:48:25.921507 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.921483    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/sub-test-model-118a8c-kserve-69db776f55-5zwgl"]
Jul 23 18:48:25.980476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:25.980449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"]
Jul 23 18:48:25.981066 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:48:25.981042    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d7def3e_5d6d_4d69_a70c_064cab180460.slice/crio-a89117d23e0efb4b70388354428330a94398411800999d1f98b951f4ece9ba01 WatchSource:0}: Error finding container a89117d23e0efb4b70388354428330a94398411800999d1f98b951f4ece9ba01: Status 404 returned error can't find the container with id a89117d23e0efb4b70388354428330a94398411800999d1f98b951f4ece9ba01
Jul 23 18:48:26.121798 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:26.121727    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17fbaf8e-76b3-4e27-b34a-796d35b2930a" path="/var/lib/kubelet/pods/17fbaf8e-76b3-4e27-b34a-796d35b2930a/volumes"
Jul 23 18:48:26.122154 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:26.122141    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3511c4-f321-46b0-9f00-0568cbfb97f6" path="/var/lib/kubelet/pods/2b3511c4-f321-46b0-9f00-0568cbfb97f6/volumes"
Jul 23 18:48:26.892908 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:26.892872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt" event={"ID":"3d7def3e-5d6d-4d69-a70c-064cab180460","Type":"ContainerStarted","Data":"c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28"}
Jul 23 18:48:26.893305 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:26.892916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt" event={"ID":"3d7def3e-5d6d-4d69-a70c-064cab180460","Type":"ContainerStarted","Data":"a89117d23e0efb4b70388354428330a94398411800999d1f98b951f4ece9ba01"}
Jul 23 18:48:26.913900 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:26.913855    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt" podStartSLOduration=1.9138397889999998 podStartE2EDuration="1.913839789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:48:26.912947042 +0000 UTC m=+2769.325649831" watchObservedRunningTime="2026-07-23 18:48:26.913839789 +0000 UTC m=+2769.326542577"
Jul 23 18:48:35.844346 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:35.844317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:35.844763 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:35.844359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:35.857282 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:35.857260    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:35.946540 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:35.946510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:48:52.314694 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.314662    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"]
Jul 23 18:48:52.317369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.317350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.320860 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.320839    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"rate-test-model-118a8c-kserve-self-signed-certs\""
Jul 23 18:48:52.322095 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.322069    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"default-dockercfg-g4bc5\""
Jul 23 18:48:52.322197 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.322103    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"openshift-service-ca.crt\""
Jul 23 18:48:52.322351 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.322336    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-118a8c\"/\"kube-root-ca.crt\""
Jul 23 18:48:52.330274 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.330252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"]
Jul 23 18:48:52.439570 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.439547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540181be-2fb5-49b8-89ec-97b4eb7cc769-tls-certs\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.439712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.439578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkq6j\" (UniqueName: \"kubernetes.io/projected/540181be-2fb5-49b8-89ec-97b4eb7cc769-kube-api-access-gkq6j\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.439712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.439600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-dshm\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.439712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.439622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-model-cache\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.439712 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.439696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-home\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.439915 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.439819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-tmp-dir\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.540941 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.540918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-dshm\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541057 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.540950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-model-cache\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541057 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.540969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-home\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541057 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.541019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-tmp-dir\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541057 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.541040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540181be-2fb5-49b8-89ec-97b4eb7cc769-tls-certs\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541256 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.541060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkq6j\" (UniqueName: \"kubernetes.io/projected/540181be-2fb5-49b8-89ec-97b4eb7cc769-kube-api-access-gkq6j\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541351 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.541327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-model-cache\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541428 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.541355    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-tmp-dir\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.541470 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.541444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-home\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.543186 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.543166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-dshm\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.543449 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.543432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540181be-2fb5-49b8-89ec-97b4eb7cc769-tls-certs\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.551473 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.551450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkq6j\" (UniqueName: \"kubernetes.io/projected/540181be-2fb5-49b8-89ec-97b4eb7cc769-kube-api-access-gkq6j\") pod \"rate-test-model-118a8c-kserve-7d8744b875-h88k2\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") " pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.626713 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.626661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:48:52.756377 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:52.756353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"]
Jul 23 18:48:52.758622 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:48:52.758595    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod540181be_2fb5_49b8_89ec_97b4eb7cc769.slice/crio-58119b7d38c26ee57bec9296303bef91fe3ae85c3d99df00c186f634d208d6f2 WatchSource:0}: Error finding container 58119b7d38c26ee57bec9296303bef91fe3ae85c3d99df00c186f634d208d6f2: Status 404 returned error can't find the container with id 58119b7d38c26ee57bec9296303bef91fe3ae85c3d99df00c186f634d208d6f2
Jul 23 18:48:53.015917 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:53.015833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2" event={"ID":"540181be-2fb5-49b8-89ec-97b4eb7cc769","Type":"ContainerStarted","Data":"7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8"}
Jul 23 18:48:53.015917 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:53.015880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2" event={"ID":"540181be-2fb5-49b8-89ec-97b4eb7cc769","Type":"ContainerStarted","Data":"58119b7d38c26ee57bec9296303bef91fe3ae85c3d99df00c186f634d208d6f2"}
Jul 23 18:48:53.042925 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:48:53.042879    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2" podStartSLOduration=1.042862515 podStartE2EDuration="1.042862515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:48:53.04077259 +0000 UTC m=+2795.453475379" watchObservedRunningTime="2026-07-23 18:48:53.042862515 +0000 UTC m=+2795.455565302"
Jul 23 18:49:02.626792 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:02.626758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:49:02.627235 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:02.626803    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:49:02.639148 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:02.639128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:49:03.074052 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:03.074023    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:49:39.732043 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:39.732010    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"]
Jul 23 18:49:40.629146 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:40.629116    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"]
Jul 23 18:49:54.751533 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:54.751475    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt" podUID="3d7def3e-5d6d-4d69-a70c-064cab180460" containerName="main" containerID="cri-o://c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28" gracePeriod=45
Jul 23 18:49:55.000969 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.000943    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:49:55.084791 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.084754    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-tmp-dir\") pod \"3d7def3e-5d6d-4d69-a70c-064cab180460\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") "
Jul 23 18:49:55.084791 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.084796    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-model-cache\") pod \"3d7def3e-5d6d-4d69-a70c-064cab180460\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") "
Jul 23 18:49:55.084976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.084823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgcnr\" (UniqueName: \"kubernetes.io/projected/3d7def3e-5d6d-4d69-a70c-064cab180460-kube-api-access-jgcnr\") pod \"3d7def3e-5d6d-4d69-a70c-064cab180460\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") "
Jul 23 18:49:55.084976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.084871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-home\") pod \"3d7def3e-5d6d-4d69-a70c-064cab180460\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") "
Jul 23 18:49:55.084976 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.084914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-dshm\") pod \"3d7def3e-5d6d-4d69-a70c-064cab180460\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") "
Jul 23 18:49:55.085131 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7def3e-5d6d-4d69-a70c-064cab180460-tls-certs\") pod \"3d7def3e-5d6d-4d69-a70c-064cab180460\" (UID: \"3d7def3e-5d6d-4d69-a70c-064cab180460\") "
Jul 23 18:49:55.085188 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3d7def3e-5d6d-4d69-a70c-064cab180460" (UID: "3d7def3e-5d6d-4d69-a70c-064cab180460"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.085188 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085041    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-model-cache" (OuterVolumeSpecName: "model-cache") pod "3d7def3e-5d6d-4d69-a70c-064cab180460" (UID: "3d7def3e-5d6d-4d69-a70c-064cab180460"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.085188 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085120    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-home" (OuterVolumeSpecName: "home") pod "3d7def3e-5d6d-4d69-a70c-064cab180460" (UID: "3d7def3e-5d6d-4d69-a70c-064cab180460"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.085330 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085260    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.085330 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085273    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.085330 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.085281    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.087025 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.086997    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d7def3e-5d6d-4d69-a70c-064cab180460-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3d7def3e-5d6d-4d69-a70c-064cab180460" (UID: "3d7def3e-5d6d-4d69-a70c-064cab180460"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:49:55.087121 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.087035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-dshm" (OuterVolumeSpecName: "dshm") pod "3d7def3e-5d6d-4d69-a70c-064cab180460" (UID: "3d7def3e-5d6d-4d69-a70c-064cab180460"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.087121 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.087050    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7def3e-5d6d-4d69-a70c-064cab180460-kube-api-access-jgcnr" (OuterVolumeSpecName: "kube-api-access-jgcnr") pod "3d7def3e-5d6d-4d69-a70c-064cab180460" (UID: "3d7def3e-5d6d-4d69-a70c-064cab180460"). InnerVolumeSpecName "kube-api-access-jgcnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:55.185668 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.185645    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgcnr\" (UniqueName: \"kubernetes.io/projected/3d7def3e-5d6d-4d69-a70c-064cab180460-kube-api-access-jgcnr\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.185668 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.185666    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d7def3e-5d6d-4d69-a70c-064cab180460-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.185799 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.185675    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d7def3e-5d6d-4d69-a70c-064cab180460-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.305149 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.305118    2578 generic.go:356] "Generic (PLEG): container finished" podID="3d7def3e-5d6d-4d69-a70c-064cab180460" containerID="c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28" exitCode=0
Jul 23 18:49:55.305290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.305162    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"
Jul 23 18:49:55.305290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.305165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt" event={"ID":"3d7def3e-5d6d-4d69-a70c-064cab180460","Type":"ContainerDied","Data":"c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28"}
Jul 23 18:49:55.305290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.305208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt" event={"ID":"3d7def3e-5d6d-4d69-a70c-064cab180460","Type":"ContainerDied","Data":"a89117d23e0efb4b70388354428330a94398411800999d1f98b951f4ece9ba01"}
Jul 23 18:49:55.305290 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.305233    2578 scope.go:117] "RemoveContainer" containerID="c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28"
Jul 23 18:49:55.313941 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.313925    2578 scope.go:117] "RemoveContainer" containerID="c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28"
Jul 23 18:49:55.314169 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:49:55.314154    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28\": container with ID starting with c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28 not found: ID does not exist" containerID="c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28"
Jul 23 18:49:55.314217 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.314177    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28"} err="failed to get container status \"c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28\": rpc error: code = NotFound desc = could not find container \"c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28\": container with ID starting with c8999af402ffc52616061fc5b03adb3e38bc0ad4b34820cbd825cd3153c1fa28 not found: ID does not exist"
Jul 23 18:49:55.332441 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.332420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"]
Jul 23 18:49:55.335866 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.335820    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d87a73/rate-test-model-d87a73-kserve-75ddd65cf5-qp8qt"]
Jul 23 18:49:55.648360 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.648283    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2" podUID="540181be-2fb5-49b8-89ec-97b4eb7cc769" containerName="main" containerID="cri-o://7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8" gracePeriod=45
Jul 23 18:49:55.897870 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.897844    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:49:55.993445 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-dshm\") pod \"540181be-2fb5-49b8-89ec-97b4eb7cc769\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") "
Jul 23 18:49:55.993445 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkq6j\" (UniqueName: \"kubernetes.io/projected/540181be-2fb5-49b8-89ec-97b4eb7cc769-kube-api-access-gkq6j\") pod \"540181be-2fb5-49b8-89ec-97b4eb7cc769\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") "
Jul 23 18:49:55.993625 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993447    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-tmp-dir\") pod \"540181be-2fb5-49b8-89ec-97b4eb7cc769\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") "
Jul 23 18:49:55.993625 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-model-cache\") pod \"540181be-2fb5-49b8-89ec-97b4eb7cc769\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") "
Jul 23 18:49:55.993625 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993553    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540181be-2fb5-49b8-89ec-97b4eb7cc769-tls-certs\") pod \"540181be-2fb5-49b8-89ec-97b4eb7cc769\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") "
Jul 23 18:49:55.993625 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993591    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-home\") pod \"540181be-2fb5-49b8-89ec-97b4eb7cc769\" (UID: \"540181be-2fb5-49b8-89ec-97b4eb7cc769\") "
Jul 23 18:49:55.993837 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993719    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "540181be-2fb5-49b8-89ec-97b4eb7cc769" (UID: "540181be-2fb5-49b8-89ec-97b4eb7cc769"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.993888 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-model-cache" (OuterVolumeSpecName: "model-cache") pod "540181be-2fb5-49b8-89ec-97b4eb7cc769" (UID: "540181be-2fb5-49b8-89ec-97b4eb7cc769"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.993888 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993849    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-tmp-dir\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:55.993959 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.993882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-home" (OuterVolumeSpecName: "home") pod "540181be-2fb5-49b8-89ec-97b4eb7cc769" (UID: "540181be-2fb5-49b8-89ec-97b4eb7cc769"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.995435 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.995403    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-dshm" (OuterVolumeSpecName: "dshm") pod "540181be-2fb5-49b8-89ec-97b4eb7cc769" (UID: "540181be-2fb5-49b8-89ec-97b4eb7cc769"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:55.995517 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.995476    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540181be-2fb5-49b8-89ec-97b4eb7cc769-kube-api-access-gkq6j" (OuterVolumeSpecName: "kube-api-access-gkq6j") pod "540181be-2fb5-49b8-89ec-97b4eb7cc769" (UID: "540181be-2fb5-49b8-89ec-97b4eb7cc769"). InnerVolumeSpecName "kube-api-access-gkq6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:55.995615 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:55.995584    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/540181be-2fb5-49b8-89ec-97b4eb7cc769-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "540181be-2fb5-49b8-89ec-97b4eb7cc769" (UID: "540181be-2fb5-49b8-89ec-97b4eb7cc769"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:49:56.094721 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.094696    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-model-cache\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:56.094721 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.094718    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540181be-2fb5-49b8-89ec-97b4eb7cc769-tls-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:56.094865 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.094727    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-home\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:56.094865 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.094734    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540181be-2fb5-49b8-89ec-97b4eb7cc769-dshm\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:56.094865 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.094742    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkq6j\" (UniqueName: \"kubernetes.io/projected/540181be-2fb5-49b8-89ec-97b4eb7cc769-kube-api-access-gkq6j\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 23 18:49:56.121418 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.121385    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7def3e-5d6d-4d69-a70c-064cab180460" path="/var/lib/kubelet/pods/3d7def3e-5d6d-4d69-a70c-064cab180460/volumes"
Jul 23 18:49:56.311007 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.310980    2578 generic.go:356] "Generic (PLEG): container finished" podID="540181be-2fb5-49b8-89ec-97b4eb7cc769" containerID="7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8" exitCode=0
Jul 23 18:49:56.311118 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.311021    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"
Jul 23 18:49:56.311118 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.311065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2" event={"ID":"540181be-2fb5-49b8-89ec-97b4eb7cc769","Type":"ContainerDied","Data":"7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8"}
Jul 23 18:49:56.311118 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.311101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2" event={"ID":"540181be-2fb5-49b8-89ec-97b4eb7cc769","Type":"ContainerDied","Data":"58119b7d38c26ee57bec9296303bef91fe3ae85c3d99df00c186f634d208d6f2"}
Jul 23 18:49:56.311260 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.311124    2578 scope.go:117] "RemoveContainer" containerID="7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8"
Jul 23 18:49:56.319336 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.319318    2578 scope.go:117] "RemoveContainer" containerID="7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8"
Jul 23 18:49:56.319615 ip-10-0-137-162 kubenswrapper[2578]: E0723 18:49:56.319598    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8\": container with ID starting with 7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8 not found: ID does not exist" containerID="7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8"
Jul 23 18:49:56.319679 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.319623    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8"} err="failed to get container status \"7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8\": rpc error: code = NotFound desc = could not find container \"7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8\": container with ID starting with 7a478703d38e8387d79e375f4de9ae6372a66f09e6863959481845fa26660bf8 not found: ID does not exist"
Jul 23 18:49:56.333877 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.333851    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"]
Jul 23 18:49:56.337589 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:56.337570    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-118a8c/rate-test-model-118a8c-kserve-7d8744b875-h88k2"]
Jul 23 18:49:58.122196 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:49:58.122164    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="540181be-2fb5-49b8-89ec-97b4eb7cc769" path="/var/lib/kubelet/pods/540181be-2fb5-49b8-89ec-97b4eb7cc769/volumes"
Jul 23 18:50:46.604576 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:46.604540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8ddd58c4f-bkq45_8c96b805-c16c-471b-997a-fb2a244b7728/authorino/0.log"
Jul 23 18:50:52.624133 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:52.624101    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76f757f7f7-qx78t_887a6cb9-f789-4142-b137-e4d2434dc77f/manager/0.log"
Jul 23 18:50:53.327120 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:53.327097    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-vr265_b08812e9-bc01-4569-8163-c8beb581342a/copy-manifests/0.log"
Jul 23 18:50:53.335688 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:53.335663    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-vr265_b08812e9-bc01-4569-8163-c8beb581342a/manager/0.log"
Jul 23 18:50:55.645140 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:55.645112    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8ddd58c4f-bkq45_8c96b805-c16c-471b-997a-fb2a244b7728/authorino/0.log"
Jul 23 18:50:55.930847 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:55.930778    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ww6l5_c1cd6875-496b-4127-a215-eb08e41d643c/manager/0.log"
Jul 23 18:50:56.575822 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:56.575790    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lbl5z_8d207e04-19af-4fdb-901b-7567061a93f5/manager/0.log"
Jul 23 18:50:57.226123 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:57.226093    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-2zqjq_6777b2a5-f620-4f58-957a-be85058b40ea/kube-auth-proxy/0.log"
Jul 23 18:50:58.282844 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:58.282816    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5mg2z_599c3c05-c048-4012-9ca8-dc561915a497/main/0.log"
Jul 23 18:50:58.528751 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:58.528679    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-xhbsz_f2932802-af14-43bb-bf44-54bb6513e200/main/0.log"
Jul 23 18:50:58.778526 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:50:58.778498    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rb54c_cb31e569-ea21-495e-a5bd-8937c77620fa/main/0.log"
Jul 23 18:51:07.925777 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:07.925748    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mxhw6_3b4e3eef-9fac-4b55-ad64-b51b68d72ba7/global-pull-secret-syncer/0.log"
Jul 23 18:51:08.189212 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:08.189145    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vxkzb_ba8260da-1727-4036-9863-bf1197441f18/konnectivity-agent/0.log"
Jul 23 18:51:08.250779 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:08.250751    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-162.ec2.internal_f70772c471111bb88b9c0b05ceea9c74/haproxy/0.log"
Jul 23 18:51:13.803085 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:13.803056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8ddd58c4f-bkq45_8c96b805-c16c-471b-997a-fb2a244b7728/authorino/0.log"
Jul 23 18:51:13.950107 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:13.950079    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ww6l5_c1cd6875-496b-4127-a215-eb08e41d643c/manager/0.log"
Jul 23 18:51:14.413583 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:14.413554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lbl5z_8d207e04-19af-4fdb-901b-7567061a93f5/manager/0.log"
Jul 23 18:51:16.424199 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:16.424140    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-gwt8v_58a9230c-14ed-451a-b8e8-80e0571e4475/cluster-monitoring-operator/0.log"
Jul 23 18:51:16.585183 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:16.585158    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86dd4ff6fd-krgrl_59148476-a601-4373-8336-a8e488f12450/metrics-server/0.log"
Jul 23 18:51:16.618216 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:16.618193    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-z7k7w_52d73c32-4eb7-43ca-bdd2-eeb560826322/monitoring-plugin/0.log"
Jul 23 18:51:16.885823 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:16.885794    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzpqh_1100232d-8e8d-4a05-aa82-1eca348910cc/node-exporter/0.log"
Jul 23 18:51:16.923184 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:16.923161    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzpqh_1100232d-8e8d-4a05-aa82-1eca348910cc/kube-rbac-proxy/0.log"
Jul 23 18:51:16.958476 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:16.958459    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzpqh_1100232d-8e8d-4a05-aa82-1eca348910cc/init-textfile/0.log"
Jul 23 18:51:17.125695 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.125671    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/prometheus/0.log"
Jul 23 18:51:17.166769 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.166695    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/config-reloader/0.log"
Jul 23 18:51:17.208863 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.208827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/thanos-sidecar/0.log"
Jul 23 18:51:17.268094 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.268075    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/kube-rbac-proxy-web/0.log"
Jul 23 18:51:17.334477 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.334459    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/kube-rbac-proxy/0.log"
Jul 23 18:51:17.485185 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.485117    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/kube-rbac-proxy-thanos/0.log"
Jul 23 18:51:17.578208 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.578163    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c98a8a7b-d11d-40fa-b413-c8a0776a0f37/init-config-reloader/0.log"
Jul 23 18:51:17.835519 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.835495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df8c9dd69-fd5gd_3c266fff-43ce-49a6-bef4-2c0db59362a6/thanos-query/0.log"
Jul 23 18:51:17.866595 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.866562    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df8c9dd69-fd5gd_3c266fff-43ce-49a6-bef4-2c0db59362a6/kube-rbac-proxy-web/0.log"
Jul 23 18:51:17.897172 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.897148    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df8c9dd69-fd5gd_3c266fff-43ce-49a6-bef4-2c0db59362a6/kube-rbac-proxy/0.log"
Jul 23 18:51:17.925245 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.925225    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df8c9dd69-fd5gd_3c266fff-43ce-49a6-bef4-2c0db59362a6/prom-label-proxy/0.log"
Jul 23 18:51:17.955134 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.955097    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df8c9dd69-fd5gd_3c266fff-43ce-49a6-bef4-2c0db59362a6/kube-rbac-proxy-rules/0.log"
Jul 23 18:51:17.983655 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:17.983615    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5df8c9dd69-fd5gd_3c266fff-43ce-49a6-bef4-2c0db59362a6/kube-rbac-proxy-metrics/0.log"
Jul 23 18:51:18.384710 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.384665    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"]
Jul 23 18:51:18.385134 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.385116    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7def3e-5d6d-4d69-a70c-064cab180460" containerName="main"
Jul 23 18:51:18.385234 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.385138    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7def3e-5d6d-4d69-a70c-064cab180460" containerName="main"
Jul 23 18:51:18.385234 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.385168    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540181be-2fb5-49b8-89ec-97b4eb7cc769" containerName="main"
Jul 23 18:51:18.385234 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.385176    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="540181be-2fb5-49b8-89ec-97b4eb7cc769" containerName="main"
Jul 23 18:51:18.385396 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.385269    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7def3e-5d6d-4d69-a70c-064cab180460" containerName="main"
Jul 23 18:51:18.385396 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.385285    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="540181be-2fb5-49b8-89ec-97b4eb7cc769" containerName="main"
Jul 23 18:51:18.388633 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.388611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.391642 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.391620    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xtf\"/\"openshift-service-ca.crt\""
Jul 23 18:51:18.391899 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.391884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9xtf\"/\"default-dockercfg-8ktnr\""
Jul 23 18:51:18.392710 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.392693    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xtf\"/\"kube-root-ca.crt\""
Jul 23 18:51:18.398719 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.398698    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"]
Jul 23 18:51:18.571737 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.571699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-lib-modules\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.572161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.571746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-proc\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.572161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.571818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvr8\" (UniqueName: \"kubernetes.io/projected/972c9291-a723-4e81-8a6a-624d0e59ddec-kube-api-access-xmvr8\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.572161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.571896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-sys\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.572161 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.571950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-podres\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673149 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-lib-modules\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673149 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-proc\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673149 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvr8\" (UniqueName: \"kubernetes.io/projected/972c9291-a723-4e81-8a6a-624d0e59ddec-kube-api-access-xmvr8\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-sys\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-podres\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-proc\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-sys\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-lib-modules\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.673369 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.673302    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/972c9291-a723-4e81-8a6a-624d0e59ddec-podres\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.683581 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.683562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvr8\" (UniqueName: \"kubernetes.io/projected/972c9291-a723-4e81-8a6a-624d0e59ddec-kube-api-access-xmvr8\") pod \"perf-node-gather-daemonset-gxfp5\" (UID: \"972c9291-a723-4e81-8a6a-624d0e59ddec\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.699128 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.699097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:18.827600 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:18.827576    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"]
Jul 23 18:51:18.831825 ip-10-0-137-162 kubenswrapper[2578]: W0723 18:51:18.829889    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod972c9291_a723_4e81_8a6a_624d0e59ddec.slice/crio-483fcf1d5a5d35597d7a95e2f8bb5a1eb858b13a18e4c28ec41b99130b81eb74 WatchSource:0}: Error finding container 483fcf1d5a5d35597d7a95e2f8bb5a1eb858b13a18e4c28ec41b99130b81eb74: Status 404 returned error can't find the container with id 483fcf1d5a5d35597d7a95e2f8bb5a1eb858b13a18e4c28ec41b99130b81eb74
Jul 23 18:51:19.702645 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:19.702614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5" event={"ID":"972c9291-a723-4e81-8a6a-624d0e59ddec","Type":"ContainerStarted","Data":"0f0b9f1638a764327089e9a8dc8d65c7634729ab631b86824ecbe3bc9cf3d756"}
Jul 23 18:51:19.703028 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:19.702663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5" event={"ID":"972c9291-a723-4e81-8a6a-624d0e59ddec","Type":"ContainerStarted","Data":"483fcf1d5a5d35597d7a95e2f8bb5a1eb858b13a18e4c28ec41b99130b81eb74"}
Jul 23 18:51:19.703028 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:19.702749    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:19.722685 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:19.722645    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5" podStartSLOduration=1.72263312 podStartE2EDuration="1.72263312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:19.721085933 +0000 UTC m=+2942.133788720" watchObservedRunningTime="2026-07-23 18:51:19.72263312 +0000 UTC m=+2942.135335912"
Jul 23 18:51:20.395462 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:20.395436    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55958d7bc9-47d5q_7a2f43e4-b4d2-4087-921a-55e2ccbf7bf9/console/0.log"
Jul 23 18:51:20.435917 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:20.435891    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-n7dn5_e9ad958d-7fe3-4384-bd97-a16d6ee756ed/download-server/0.log"
Jul 23 18:51:22.389171 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:22.389142    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tfhcq_b32355be-6a39-4b3f-95e0-8b320036a69c/dns/0.log"
Jul 23 18:51:22.420338 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:22.420317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tfhcq_b32355be-6a39-4b3f-95e0-8b320036a69c/kube-rbac-proxy/0.log"
Jul 23 18:51:22.450960 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:22.450944    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6m8fr_696a2281-26ef-43ff-a78e-d02bab924388/dns-node-resolver/0.log"
Jul 23 18:51:23.174160 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:23.174133    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kzc8d_5842ed4d-93da-42af-a368-eae65c64dc89/node-ca/0.log"
Jul 23 18:51:24.554263 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:24.554232    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-2zqjq_6777b2a5-f620-4f58-957a-be85058b40ea/kube-auth-proxy/0.log"
Jul 23 18:51:25.708766 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:25.708729    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w2psm_7a507bcd-b2a9-4332-9eb2-5c4c109139a4/serve-healthcheck-canary/0.log"
Jul 23 18:51:25.716245 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:25.716222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-gxfp5"
Jul 23 18:51:26.241573 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:26.241547    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2czr4_0ac2c07f-876c-4f8c-869b-29fd7f571275/insights-operator/0.log"
Jul 23 18:51:26.243370 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:26.243351    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2czr4_0ac2c07f-876c-4f8c-869b-29fd7f571275/insights-operator/1.log"
Jul 23 18:51:26.425016 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:26.424991    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frb6w_c69a7cbc-a579-410e-b848-68d5ff435526/kube-rbac-proxy/0.log"
Jul 23 18:51:26.463782 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:26.463762    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frb6w_c69a7cbc-a579-410e-b848-68d5ff435526/exporter/0.log"
Jul 23 18:51:26.504629 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:26.504570    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frb6w_c69a7cbc-a579-410e-b848-68d5ff435526/extractor/0.log"
Jul 23 18:51:28.452483 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:28.452445    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-2zqjq_6777b2a5-f620-4f58-957a-be85058b40ea/kube-auth-proxy/0.log"
Jul 23 18:51:29.619594 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:29.619567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76f757f7f7-qx78t_887a6cb9-f789-4142-b137-e4d2434dc77f/manager/0.log"
Jul 23 18:51:30.102892 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:30.102866    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-vr265_b08812e9-bc01-4569-8163-c8beb581342a/manager/0.log"
Jul 23 18:51:30.174787 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:30.174719    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-vr265_b08812e9-bc01-4569-8163-c8beb581342a/copy-manifests/0.log"
Jul 23 18:51:30.364838 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:30.364815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-2zqjq_6777b2a5-f620-4f58-957a-be85058b40ea/kube-auth-proxy/0.log"
Jul 23 18:51:31.774533 ip-10-0-137-162 kubenswrapper[2578]: I0723 18:51:31.774508    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-689d89c9b7-m8tsx_a1e1929f-75a9-4f65-8e8e-c6b824b7e3c5/manager/0.log"